[ 519.599057] env[64976]: /opt/stack/neutron/neutron/__init__.py:25: UserWarning: The selected oslo_service backend is "eventlet" [ 519.599057] env[64976]: warnings.warn('The selected oslo_service backend is "eventlet"') [ 520.535947] env[65065]: /opt/stack/neutron/neutron/__init__.py:25: UserWarning: The selected oslo_service backend is "eventlet" [ 520.535947] env[65065]: warnings.warn('The selected oslo_service backend is "eventlet"') [ 522.092473] env[65065]: INFO neutron.common.config [-] Logging enabled! [ 522.092744] env[65065]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev74 [ 522.093019] env[65065]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=65065) setup_logging /opt/stack/neutron/neutron/common/config.py:124}} [ 522.093336] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ... [ 522.093432] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed. [ 522.094285] env[65065]: WARNING oslo_policy.policy [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 522.094507] env[65065]: WARNING oslo_policy.policy [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 522.096224] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] VMware NSXv3 Agent initialized successfully. [ 522.096583] env[65065]: DEBUG oslo_concurrency.lockutils [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] Acquiring lock "singleton_lock" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 522.096732] env[65065]: DEBUG oslo_concurrency.lockutils [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] Acquired lock "singleton_lock" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 522.096944] env[65065]: DEBUG oslo_concurrency.lockutils [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] Releasing lock "singleton_lock" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 522.097247] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] Full set of CONF: {{(pid=65065) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:275}} [ 522.097356] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] ******************************************************************************** {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} [ 522.097456] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] Configuration options gathered from: {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} [ 522.097808] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--config-file', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} [ 522.098040] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} [ 522.098128] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] ================================================================================ {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} [ 522.098290] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] agent_down_time = 75 {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.098427] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] allow_automatic_dhcp_failover = True {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.098560] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] allow_bulk = True {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.098697] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] api_extensions_path = {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.098835] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] api_paste_config = api-paste.ini {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.098970] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] auth_strategy = keystone {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.099081] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] backdoor_port = None {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.099180] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] backdoor_socket = None {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.099310] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] backlog = 4096 {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.099442] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] base_mac = fa:16:3e:00:00:00 {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.099592] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] bind_host = 0.0.0.0 {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.099727] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] bind_port = 9696 {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.099857] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] client_socket_timeout = 900 {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.099994] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] config_dir = [] {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.100108] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.100242] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] config_source = [] {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.100376] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] control_exchange = neutron {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.100513] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] core_plugin = ml2 {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.100646] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] debug = True {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.100781] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] default_availability_zones = [] {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.101019] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.101169] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] dhcp_agent_notification = True {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.101302] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] dhcp_agents_per_network = 1 {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.101432] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] dhcp_lease_duration = 86400 {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.101569] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] dhcp_load_type = networks {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.101703] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] dns_domain = openstacklocal {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.101835] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.101966] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] enable_default_route_bfd = False {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.102100] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] enable_default_route_ecmp = False {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.102225] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] enable_dvr = True {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.102350] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] enable_new_agents = True {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.102477] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] enable_services_on_agents_with_admin_state_down = False {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.102603] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] enable_signals = True {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.102729] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] enable_traditional_dhcp = True {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.102856] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] external_dns_driver = None {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.102981] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] filter_validation = True {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.103125] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] global_physnet_mtu = 8950 {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.103251] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] graceful_shutdown_timeout = 60 {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.103416] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] host = cpu-1 {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.103550] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] host_dvr_for_dhcp = True {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.103700] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] http_retries = 3 {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.103839] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] instance_format = [instance: %(uuid)s] {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.103971] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.104117] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] ipam_driver = internal {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.104244] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] ipv6_pd_enabled = False {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.104371] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] l3_ha = False {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.104502] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.104635] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] l3_ha_network_physical_name = {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.104766] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] l3_ha_network_type = {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.104901] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] log_color = False {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.105043] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] log_config_append = None {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.105180] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.105308] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] log_dir = None {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.105435] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] log_file = None {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.105535] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] log_options = True {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.105664] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] log_rotate_interval = 1 {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.105822] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] log_rotate_interval_type = days {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.105961] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] log_rotation_type = none {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.106072] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.106171] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.106307] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.106437] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.106535] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.106687] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] max_dns_nameservers = 5 {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.106824] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] max_header_line = 16384 {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.106950] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] max_l3_agents_per_router = 3 {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.107090] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] max_logfile_count = 30 {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.107219] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] max_logfile_size_mb = 200 {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.107346] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] max_subnet_host_routes = 20 {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.107482] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] my_ip = 10.180.1.21 {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.107617] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] my_ipv6 = ::1 {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.107748] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] network_auto_schedule = True {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.107873] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] network_link_prefix = None {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.108019] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.108166] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] notify_nova_on_port_data_changes = True {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.108299] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] notify_nova_on_port_status_changes = True {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.108433] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] pagination_max_limit = -1 {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.108562] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] publish_errors = False {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.108691] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] rate_limit_burst = 0 {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.108827] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] rate_limit_except_level = CRITICAL {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.108954] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] rate_limit_interval = 0 {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.109090] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] retry_until_window = 30 {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.109222] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] router_distributed = False {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.109352] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] rpc_resources_processing_step = 20 {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.109483] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] rpc_response_max_timeout = 600 {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.109614] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] rpc_response_timeout = 60 {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.109769] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] send_events_interval = 2 {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.109921] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] service_plugins = ['router'] {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.110069] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] setproctitle = on {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.110198] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] shell_completion = None {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.110334] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] state_path = /opt/stack/data/neutron {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.110469] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] syslog_log_facility = LOG_USER {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.110601] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] tcp_keepidle = 600 {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.110738] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] transport_url = **** {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.110869] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] use_journal = False {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.111000] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] use_json = False {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.111142] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] use_ssl = False {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.111269] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] use_stderr = False {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.111405] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] use_syslog = False {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.111530] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] vlan_qinq = None {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.111655] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] vlan_transparent = None {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.111782] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] watch_log_file = False {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.111911] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] wsgi_default_pool_size = 100 {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.112046] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] wsgi_keep_alive = True {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.112185] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.112312] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] wsgi_server_debug = False {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.112456] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] oslo_concurrency.disable_process_locking = False {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.112595] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.112758] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.112900] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.113050] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.113191] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.113323] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.113470] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] profiler.connection_string = messaging:// {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.113609] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] profiler.enabled = False {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.113748] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] profiler.es_doc_type = notification {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.113878] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] profiler.es_scroll_size = 10000 {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.114021] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] profiler.es_scroll_time = 2m {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.114155] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] profiler.filter_error_trace = False {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.114290] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] profiler.hmac_keys = **** {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.114425] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] profiler.sentinel_service_name = mymaster {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.114563] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] profiler.socket_timeout = 0.1 {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.114698] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] profiler.trace_requests = False {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.114830] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] profiler.trace_sqlalchemy = False {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.114974] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] profiler_jaeger.process_tags = {} {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.115116] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] profiler_jaeger.service_name_prefix = None {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.115247] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] profiler_otlp.service_name_prefix = None {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.115391] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] oslo_policy.enforce_new_defaults = True {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.115649] env[65065]: WARNING oslo_config.cfg [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. [ 522.115837] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] oslo_policy.enforce_scope = True {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.115987] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] oslo_policy.policy_default_rule = default {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.116148] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.116288] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.116429] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.116560] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.116706] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.116845] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.116977] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.117124] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] oslo_policy.remote_timeout = 60.0 {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.117275] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.117419] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] agent.extensions = [] {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.117557] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.117692] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] service_providers.service_provider = [] {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.117833] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] QUOTAS.default_quota = -1 {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.117971] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.118145] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] QUOTAS.quota_floatingip = 50 {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.118284] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] QUOTAS.quota_network = 100 {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.118414] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] QUOTAS.quota_port = 500 {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.118543] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] QUOTAS.quota_rbac_policy = 10 {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.118672] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] QUOTAS.quota_router = 10 {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.118826] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] QUOTAS.quota_security_group = 10 {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.118967] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] QUOTAS.quota_security_group_rule = 100 {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.119110] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] QUOTAS.quota_subnet = 100 {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.119242] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] QUOTAS.track_quota_usage = True {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.119386] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.119516] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] privsep.group = None {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.119643] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] privsep.helper_command = None {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.119773] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] privsep.log_daemon_traceback = False {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.119907] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] privsep.logger_name = oslo_privsep.daemon {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.120047] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] privsep.thread_pool_size = 8 {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.120176] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] privsep.user = None {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.120313] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] privsep_dhcp_release.capabilities = [21, 12] {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.120438] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] privsep_dhcp_release.group = None {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.120565] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] privsep_dhcp_release.helper_command = None {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.120696] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] privsep_dhcp_release.log_daemon_traceback = False {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.120834] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.120959] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] privsep_dhcp_release.thread_pool_size = 8 {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.121097] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] privsep_dhcp_release.user = None {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.121229] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.121353] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] privsep_ovs_vsctl.group = None {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.121478] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] privsep_ovs_vsctl.helper_command = None {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.121606] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] privsep_ovs_vsctl.log_daemon_traceback = False {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.121744] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.121893] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] privsep_ovs_vsctl.thread_pool_size = 8 {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.122034] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] privsep_ovs_vsctl.user = None {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.122172] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] privsep_namespace.capabilities = [21] {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.122298] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] privsep_namespace.group = None {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.122427] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] privsep_namespace.helper_command = None {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.122558] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] privsep_namespace.log_daemon_traceback = False {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.122691] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.122822] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] privsep_namespace.thread_pool_size = 8 {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.122950] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] privsep_namespace.user = None {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.123095] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] privsep_conntrack.capabilities = [12] {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.123221] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] privsep_conntrack.group = None {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.123346] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] privsep_conntrack.helper_command = None {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.123475] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] privsep_conntrack.log_daemon_traceback = False {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.123606] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.123736] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] privsep_conntrack.thread_pool_size = 8 {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.123863] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] privsep_conntrack.user = None {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.123997] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] privsep_link.capabilities = [12, 21] {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.124137] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] privsep_link.group = None {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.124262] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] privsep_link.helper_command = None {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.124392] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] privsep_link.log_daemon_traceback = False {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.124523] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] privsep_link.logger_name = oslo_privsep.daemon {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.124652] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] privsep_link.thread_pool_size = 8 {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.124788] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] privsep_link.user = None {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.124956] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] AGENT.agent_id = nsxm-l-01a.corp.local {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.125142] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] AGENT.agent_prometheus_exporter_port = 8000 {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.125252] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] AGENT.continue_on_failed_promotions = False {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.125416] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] AGENT.dscp = None {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.125572] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] AGENT.dscp_inherit = False {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.125732] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] AGENT.force_mp_to_policy = True {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.125873] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] AGENT.locking_coordinator_url = None {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.126014] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] AGENT.log_agent_heartbeats = False {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.126216] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] AGENT.logging_expire = 1 {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.126288] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] AGENT.logging_url = unix:///var/run/redis/socket/redis.sock {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.126419] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] AGENT.max_sg_tags_per_segment_port = 27 {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.126558] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] AGENT.polling_interval = 240 {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.126711] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] AGENT.ports_tag_number_decrease_workaround = True {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.126861] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] AGENT.quitting_rpc_timeout = 120 {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.126999] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] AGENT.report_interval = 30.0 {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.127153] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] AGENT.root_helper = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.127289] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] AGENT.root_helper_daemon = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.127425] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] AGENT.rpc_max_records_per_query = 1000 {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.127557] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] AGENT.sync_skew = 60 {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.127689] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] AGENT.synchronization_queue_size = 20 {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.127821] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] AGENT.use_helper_for_ns_read = True {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.127959] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] SECURITYGROUP.enable_ipset = True {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.128120] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] SECURITYGROUP.enable_security_group = True {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.128259] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] SECURITYGROUP.firewall_driver = nsxv3 {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.128396] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] SECURITYGROUP.permitted_ethertypes = [] {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.128533] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] experimental.ipv6_pd_enabled = False {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.128685] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] ml2.extension_drivers = ['port_security'] {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.128819] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] ml2.external_network_type = None {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.128964] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] ml2.mechanism_drivers = ['nsxv3', 'openvswitch', 'logger'] {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.129116] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] ml2.overlay_ip_version = 4 {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.129252] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] ml2.path_mtu = 8950 {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.129387] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] ml2.physical_network_mtus = {} {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.129529] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] ml2.tenant_network_types = ['vlan'] {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.129666] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] ml2.tunnelled_network_rp_name = rp_tunnelled {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.129805] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] ml2.type_drivers = ['vlan'] {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.129945] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] AGENT_CLI.neutron_port_id = [] {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.130088] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] AGENT_CLI.neutron_qos_policy_id = [] {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.130221] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] AGENT_CLI.neutron_security_group_id = [] {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.130360] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] NSXV3.nsxv3_concurrent_requests = 40 {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.130500] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] NSXV3.nsxv3_connection_retry_count = 2 {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.130637] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] NSXV3.nsxv3_connection_retry_sleep = 2 {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.130775] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] NSXV3.nsxv3_default_policy_infrastructure_rules = True {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.130913] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] NSXV3.nsxv3_dfw_connectivity_strategy = NONE {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.131059] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] NSXV3.nsxv3_ip_discovery_switching_profile = nsx-default-ip-discovery-vlan-profile {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.131252] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] NSXV3.nsxv3_login_hostname = nsxt.osci.c.eu-de-1.cloud.sap {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.131397] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] NSXV3.nsxv3_login_password = **** {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.131540] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] NSXV3.nsxv3_login_port = 443 {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.131677] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] NSXV3.nsxv3_login_user = admin {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.131812] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] NSXV3.nsxv3_managed_hosts = [] {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.131948] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] NSXV3.nsxv3_max_records_per_query = 200 {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.132092] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] NSXV3.nsxv3_operation_retry_count = 3 {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.132223] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] NSXV3.nsxv3_operation_retry_sleep = 5 {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.132357] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] NSXV3.nsxv3_realization_timeout = 300 {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.132495] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] NSXV3.nsxv3_remove_orphan_ports_after = 2.0 {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.132629] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] NSXV3.nsxv3_request_timeout = 60 {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.132762] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] NSXV3.nsxv3_requests_per_second = 80 {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.132895] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] NSXV3.nsxv3_requests_per_second_timeout = 7 {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.133041] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] NSXV3.nsxv3_spoof_guard_switching_profile = nsx-default-spoof-guard-vif-profile {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.133186] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] NSXV3.nsxv3_suppress_ssl_warnings = True {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.133318] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] NSXV3.nsxv3_transport_zone_id_cache_time = 86400 {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.133453] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] NSXV3.nsxv3_transport_zone_name = nsx-vlan-transportzone {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.133636] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] vsphere.vsphere_login_hostname = vc-l-01a.corp.local {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.133778] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] vsphere.vsphere_login_password = VMware1! {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.133915] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] vsphere.vsphere_login_username = administrator@vsphere.local {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.134060] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] vsphere.vsphere_suppress_ssl_wornings = True {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.134200] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] nova.auth_section = None {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.134342] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] nova.auth_type = password {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.134478] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.134606] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] nova.certfile = None {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.134742] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] nova.collect_timing = False {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.134885] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] nova.endpoint_type = public {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.135029] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] nova.insecure = False {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.135151] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] nova.keyfile = None {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.135291] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] nova.region_name = RegionOne {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.135425] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] nova.split_loggers = False {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.135554] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] nova.timeout = None {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.135692] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] placement.auth_section = None {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.135851] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] placement.auth_type = password {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.135994] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.136137] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] placement.certfile = None {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.136269] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] placement.collect_timing = False {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.136409] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] placement.endpoint_type = public {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.136541] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] placement.insecure = False {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.136670] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] placement.keyfile = None {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.136823] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] placement.region_name = None {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.136959] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] placement.split_loggers = False {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.137096] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] placement.timeout = None {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.137231] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] ironic.auth_section = None {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.137360] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] ironic.auth_type = None {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.137486] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] ironic.cafile = None {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.137610] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] ironic.certfile = None {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.137775] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] ironic.collect_timing = False {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.137919] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] ironic.connect_retries = None {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.138058] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] ironic.connect_retry_delay = None {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.138189] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] ironic.enable_notifications = False {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.138313] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] ironic.endpoint_override = None {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.138443] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] ironic.insecure = False {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.138568] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] ironic.interface = None {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.138693] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] ironic.keyfile = None {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.138824] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] ironic.max_version = None {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.138948] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] ironic.min_version = None {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.139085] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] ironic.region_name = None {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.139210] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] ironic.retriable_status_codes = None {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.139335] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] ironic.service_name = None {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.139460] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] ironic.service_type = None {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.139573] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] ironic.split_loggers = False {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.139696] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] ironic.status_code_retries = None {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.139819] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] ironic.status_code_retry_delay = None {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.139943] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] ironic.timeout = None {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.140077] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] ironic.valid_interfaces = None {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.140204] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] ironic.version = None {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.140336] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] cli_script.dry_run = False {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.140477] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.140605] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.140733] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.140861] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.140988] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.141130] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.141261] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.141390] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.141518] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.141658] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.141786] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.141923] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.142070] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.142206] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.142335] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.142471] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] oslo_messaging_rabbit.processname = neutron-nsxv3-agent {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.142601] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.142731] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.142870] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.143026] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.143147] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.143276] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.143405] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.143537] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.143697] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.143838] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.143969] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.144115] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.144250] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.144399] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.144554] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] oslo_messaging_rabbit.ssl = False {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.144706] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.144848] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.144980] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.145134] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.145274] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] oslo_messaging_rabbit.ssl_version = {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.145399] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.145538] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] oslo_messaging_notifications.driver = [] {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.145667] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] oslo_messaging_notifications.retry = -1 {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.145839] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.145976] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] oslo_messaging_notifications.transport_url = **** {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.146090] env[65065]: DEBUG oslo_service.backend._eventlet.service [None req-cc03b8a8-acfe-4b04-94d2-72f9efa696e6 None None] ******************************************************************************** {{(pid=65065) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} [ 522.147272] env[65065]: DEBUG neutron.agent.securitygroups_rpc [None req-5dc288ef-8933-4403-998f-272fe36b910d None None] Init firewall settings (driver=nsxv3) {{(pid=65065) init_firewall /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:137}} [ 522.148606] env[65065]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.extensions.firewall [None req-5dc288ef-8933-4403-998f-272fe36b910d None None] Initializing NSXv3SecurityGroupsDriver dummy driver. {{(pid=65065) __init__ /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/extensions/firewall.py:16}} [ 522.148845] env[65065]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-5dc288ef-8933-4403-998f-272fe36b910d None None] RPC agent_id: nsxm-l-01a.corp.local [ 522.151107] env[65065]: DEBUG dogpile.cache.region [None req-5dc288ef-8933-4403-998f-272fe36b910d None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 522.151231] env[65065]: DEBUG dogpile.lock [None req-5dc288ef-8933-4403-998f-272fe36b910d None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 522.151326] env[65065]: DEBUG dogpile.lock [None req-5dc288ef-8933-4403-998f-272fe36b910d None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 522.151415] env[65065]: DEBUG dogpile.lock [None req-5dc288ef-8933-4403-998f-272fe36b910d None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 522.151509] env[65065]: DEBUG dogpile.cache.region [None req-5dc288ef-8933-4403-998f-272fe36b910d None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 522.151594] env[65065]: DEBUG dogpile.lock [None req-5dc288ef-8933-4403-998f-272fe36b910d None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 522.151715] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dc288ef-8933-4403-998f-272fe36b910d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 522.194408] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-5dc288ef-8933-4403-998f-272fe36b910d None None] Session token - acquiring [ 522.197009] env[65065]: DEBUG networking_nsxv3.common.locking [None req-5dc288ef-8933-4403-998f-272fe36b910d None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [, , , , , , , , , , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 522.197219] env[65065]: DEBUG oslo_concurrency.lockutils [None req-5dc288ef-8933-4403-998f-272fe36b910d None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 522.197277] env[65065]: DEBUG oslo_concurrency.lockutils [None req-5dc288ef-8933-4403-998f-272fe36b910d None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 522.197723] env[65065]: DEBUG oslo_concurrency.lockutils [None req-5dc288ef-8933-4403-998f-272fe36b910d None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 522.208578] env[65065]: DEBUG oslo_concurrency.lockutils [None req-5dc288ef-8933-4403-998f-272fe36b910d None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 522.476908] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-5dc288ef-8933-4403-998f-272fe36b910d None None] Session token - acquired, connected to NSX-T 4.1.2.0.0.22589037 [ 522.498711] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dc288ef-8933-4403-998f-272fe36b910d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 522.498944] env[65065]: DEBUG dogpile.cache.region [None req-5dc288ef-8933-4403-998f-272fe36b910d None None] Cache value generated in 0.347 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 522.498944] env[65065]: DEBUG dogpile.lock [None req-5dc288ef-8933-4403-998f-272fe36b910d None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 522.499131] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dc288ef-8933-4403-998f-272fe36b910d None None] Activating Policy API Provider. [ 522.499265] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dc288ef-8933-4403-998f-272fe36b910d None None] Looking for the default Infrastructure Rules. [ 522.563705] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dc288ef-8933-4403-998f-272fe36b910d None None] Looking for the Default Layer3 Logged Drop Section. [ 522.577850] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-5dc288ef-8933-4403-998f-272fe36b910d None None] Detected NSX-T (4, 1, 2, 0, 0, 22589037) version. [ 522.578324] env[65065]: DEBUG networking_nsxv3.common.locking [None req-5dc288ef-8933-4403-998f-272fe36b910d None None] Lock all taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 522.578490] env[65065]: DEBUG oslo_concurrency.lockutils [None req-5dc288ef-8933-4403-998f-272fe36b910d None None] Acquiring lock "all" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 522.578593] env[65065]: DEBUG oslo_concurrency.lockutils [None req-5dc288ef-8933-4403-998f-272fe36b910d None None] Acquired lock "all" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 522.578879] env[65065]: DEBUG oslo_concurrency.lockutils [None req-5dc288ef-8933-4403-998f-272fe36b910d None None] Acquired external semaphore "all" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 522.579299] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-5dc288ef-8933-4403-998f-272fe36b910d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 523.093939] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-5dc288ef-8933-4403-998f-272fe36b910d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 523.596313] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-5dc288ef-8933-4403-998f-272fe36b910d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 524.098838] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-5dc288ef-8933-4403-998f-272fe36b910d None None] Inventory metadata is going to be refreshed. [ 524.099193] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dc288ef-8933-4403-998f-272fe36b910d None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 524.856694] env[65065]: DEBUG networking_nsxv3.common.locking [None req-5dc288ef-8933-4403-998f-272fe36b910d None None] Lock Segment taken with stack trace [, , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 524.856949] env[65065]: DEBUG oslo_concurrency.lockutils [None req-5dc288ef-8933-4403-998f-272fe36b910d None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 524.856949] env[65065]: DEBUG oslo_concurrency.lockutils [None req-5dc288ef-8933-4403-998f-272fe36b910d None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 524.857248] env[65065]: DEBUG oslo_concurrency.lockutils [None req-5dc288ef-8933-4403-998f-272fe36b910d None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 524.869434] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [None req-5dc288ef-8933-4403-998f-272fe36b910d None None] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 524.870317] env[65065]: DEBUG oslo_concurrency.lockutils [None req-5dc288ef-8933-4403-998f-272fe36b910d None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 524.870957] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dc288ef-8933-4403-998f-272fe36b910d None None] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 524.888820] env[65065]: DEBUG networking_nsxv3.common.locking [None req-5dc288ef-8933-4403-998f-272fe36b910d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 524.889017] env[65065]: DEBUG oslo_concurrency.lockutils [None req-5dc288ef-8933-4403-998f-272fe36b910d None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 524.889156] env[65065]: DEBUG oslo_concurrency.lockutils [None req-5dc288ef-8933-4403-998f-272fe36b910d None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 524.889451] env[65065]: DEBUG oslo_concurrency.lockutils [None req-5dc288ef-8933-4403-998f-272fe36b910d None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 524.889615] env[65065]: DEBUG oslo_concurrency.lockutils [None req-5dc288ef-8933-4403-998f-272fe36b910d None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 524.889779] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dc288ef-8933-4403-998f-272fe36b910d None None] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 524.889923] env[65065]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dc288ef-8933-4403-998f-272fe36b910d None None] Outdated resources of Type:SegmentPort Are:set() {{(pid=65065) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 524.890043] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dc288ef-8933-4403-998f-272fe36b910d None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 524.911459] env[65065]: DEBUG networking_nsxv3.common.locking [None req-5dc288ef-8933-4403-998f-272fe36b910d None None] Lock Security Group (Rules) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 524.911737] env[65065]: DEBUG oslo_concurrency.lockutils [None req-5dc288ef-8933-4403-998f-272fe36b910d None None] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 524.911737] env[65065]: DEBUG oslo_concurrency.lockutils [None req-5dc288ef-8933-4403-998f-272fe36b910d None None] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 524.912031] env[65065]: DEBUG oslo_concurrency.lockutils [None req-5dc288ef-8933-4403-998f-272fe36b910d None None] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 524.912215] env[65065]: DEBUG oslo_concurrency.lockutils [None req-5dc288ef-8933-4403-998f-272fe36b910d None None] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 524.912358] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dc288ef-8933-4403-998f-272fe36b910d None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 524.931345] env[65065]: DEBUG networking_nsxv3.common.locking [None req-5dc288ef-8933-4403-998f-272fe36b910d None None] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 524.931586] env[65065]: DEBUG oslo_concurrency.lockutils [None req-5dc288ef-8933-4403-998f-272fe36b910d None None] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 524.931697] env[65065]: DEBUG oslo_concurrency.lockutils [None req-5dc288ef-8933-4403-998f-272fe36b910d None None] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 524.931901] env[65065]: DEBUG oslo_concurrency.lockutils [None req-5dc288ef-8933-4403-998f-272fe36b910d None None] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 524.932047] env[65065]: DEBUG oslo_concurrency.lockutils [None req-5dc288ef-8933-4403-998f-272fe36b910d None None] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 524.932190] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dc288ef-8933-4403-998f-272fe36b910d None None] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 524.951114] env[65065]: DEBUG networking_nsxv3.common.locking [None req-5dc288ef-8933-4403-998f-272fe36b910d None None] Lock Address Group taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 524.951339] env[65065]: DEBUG oslo_concurrency.lockutils [None req-5dc288ef-8933-4403-998f-272fe36b910d None None] Acquiring lock "Address Group" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 524.951464] env[65065]: DEBUG oslo_concurrency.lockutils [None req-5dc288ef-8933-4403-998f-272fe36b910d None None] Acquired lock "Address Group" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 524.951679] env[65065]: DEBUG oslo_concurrency.lockutils [None req-5dc288ef-8933-4403-998f-272fe36b910d None None] Acquired external semaphore "Address Group" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 524.951823] env[65065]: DEBUG oslo_concurrency.lockutils [None req-5dc288ef-8933-4403-998f-272fe36b910d None None] Releasing lock "Address Group" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 524.951968] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dc288ef-8933-4403-998f-272fe36b910d None None] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 524.952083] env[65065]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dc288ef-8933-4403-998f-272fe36b910d None None] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65065) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 524.952183] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dc288ef-8933-4403-998f-272fe36b910d None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 524.971774] env[65065]: DEBUG networking_nsxv3.common.locking [None req-5dc288ef-8933-4403-998f-272fe36b910d None None] Lock Segment QoS taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 524.971999] env[65065]: DEBUG oslo_concurrency.lockutils [None req-5dc288ef-8933-4403-998f-272fe36b910d None None] Acquiring lock "Segment QoS" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 524.972078] env[65065]: DEBUG oslo_concurrency.lockutils [None req-5dc288ef-8933-4403-998f-272fe36b910d None None] Acquired lock "Segment QoS" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 524.972359] env[65065]: DEBUG oslo_concurrency.lockutils [None req-5dc288ef-8933-4403-998f-272fe36b910d None None] Acquired external semaphore "Segment QoS" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 524.972484] env[65065]: DEBUG oslo_concurrency.lockutils [None req-5dc288ef-8933-4403-998f-272fe36b910d None None] Releasing lock "Segment QoS" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 524.972627] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dc288ef-8933-4403-998f-272fe36b910d None None] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 524.972730] env[65065]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dc288ef-8933-4403-998f-272fe36b910d None None] Outdated resources of Type:Segment QoS Are:set() {{(pid=65065) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 524.972837] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dc288ef-8933-4403-998f-272fe36b910d None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 524.993943] env[65065]: DEBUG networking_nsxv3.common.locking [None req-5dc288ef-8933-4403-998f-272fe36b910d None None] Lock Security Group (Members) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 524.994186] env[65065]: DEBUG oslo_concurrency.lockutils [None req-5dc288ef-8933-4403-998f-272fe36b910d None None] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 524.994230] env[65065]: DEBUG oslo_concurrency.lockutils [None req-5dc288ef-8933-4403-998f-272fe36b910d None None] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 524.994482] env[65065]: DEBUG oslo_concurrency.lockutils [None req-5dc288ef-8933-4403-998f-272fe36b910d None None] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 524.994619] env[65065]: DEBUG oslo_concurrency.lockutils [None req-5dc288ef-8933-4403-998f-272fe36b910d None None] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 524.994765] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dc288ef-8933-4403-998f-272fe36b910d None None] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 524.994865] env[65065]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5dc288ef-8933-4403-998f-272fe36b910d None None] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65065) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 524.994961] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-5dc288ef-8933-4403-998f-272fe36b910d None None] Inventory metadata have been refreshed. [ 524.995065] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-5dc288ef-8933-4403-998f-272fe36b910d None None] Dryrun:True. Metadata refresh completed. [ 524.995180] env[65065]: DEBUG oslo_concurrency.lockutils [None req-5dc288ef-8933-4403-998f-272fe36b910d None None] Releasing lock "all" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 524.996894] env[65065]: INFO neutron.agent.agent_extensions_manager [None req-5dc288ef-8933-4403-998f-272fe36b910d None None] Loaded agent extensions: [] [ 524.997615] env[65065]: DEBUG neutron_lib.callbacks.manager [None req-5dc288ef-8933-4403-998f-272fe36b910d None None] Publish callbacks [] for NSXv3 Agent (None), after_init {{(pid=65065) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} [ 525.089828] env[65065]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-5dc288ef-8933-4403-998f-272fe36b910d None None] NSXv3 Agent Agent RPC Daemon Started! [ 525.089987] env[65065]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-5dc288ef-8933-4403-998f-272fe36b910d None None] NSXv3 Agent Agent loop - iteration:0 started [ 525.090054] env[65065]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-5dc288ef-8933-4403-998f-272fe36b910d None None] NSXv3 Agent Agent out of sync with plugin! [ 529.998612] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 529.998996] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 534.999963] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 535.000351] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 540.001157] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 540.001480] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 540.042431] env[65065]: INFO networking_nsxv3.common.synchronization [None req-dceb7c7f-a063-429e-aa5c-36afb66138d1 demo admin] Enqueued Resource ID: 9d5d8147-30bf-477b-befb-05cb907513fc with Priority: HIGHEST for action security_group_rules [ 540.042975] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d5d8147-30bf-477b-befb-05cb907513fc with Priority: HIGHEST for action security_group_rules [ 540.043289] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9d5d8147-30bf-477b-befb-05cb907513fc taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 540.043411] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9d5d8147-30bf-477b-befb-05cb907513fc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 540.043479] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9d5d8147-30bf-477b-befb-05cb907513fc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 540.043814] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9d5d8147-30bf-477b-befb-05cb907513fc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 540.043988] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9d5d8147-30bf-477b-befb-05cb907513fc',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 540.565244] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 540.565529] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 540.565529] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 540.565674] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 540.565765] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 540.565857] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9d5d8147-30bf-477b-befb-05cb907513fc already deleted. [ 540.565940] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9d5d8147-30bf-477b-befb-05cb907513fc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 545.043849] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 545.044288] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 550.044911] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 550.045384] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 555.045486] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 555.045855] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 557.001100] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 557.001578] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 557.001578] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 557.001578] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 557.001761] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 557.504797] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 558.007743] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 558.509888] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 558.510165] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 559.275462] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 559.275996] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 559.275996] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 559.275996] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 559.289628] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 559.290503] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 559.291551] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 559.311743] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 559.312064] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 559.312064] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 559.313029] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 559.313029] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 559.313029] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 559.313029] env[65065]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65065) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 559.313029] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 559.333345] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 559.333632] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 559.333632] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 559.333765] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 559.333862] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 559.333967] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 559.357015] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 559.357315] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 559.357315] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 559.357480] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 559.357532] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 559.357638] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 559.379302] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 559.379621] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 559.379621] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 559.379746] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 559.379801] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 559.379899] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 559.379966] env[65065]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65065) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 559.380039] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 559.401168] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 559.401471] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 559.401471] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 559.401598] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 559.401648] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 559.401739] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 559.401808] env[65065]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65065) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 559.401875] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 559.426427] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 559.426720] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 559.426720] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 559.426841] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 559.426915] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 559.427036] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 559.427119] env[65065]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65065) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 559.427173] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 559.427220] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 559.427295] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 559.427347] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 559.427409] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 559.427707] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 559.427813] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 559.427862] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 559.451642] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 559.451935] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 559.451935] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 559.452077] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 559.452147] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 559.452263] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 559.472915] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 559.473237] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 559.473237] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 559.473365] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 559.473424] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 559.488551] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 560.046147] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 560.046427] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 564.559434] env[65065]: INFO networking_nsxv3.common.synchronization [None req-0c7bde38-a86a-4ba3-a198-32182dc0e2de None None] Enqueued Resource ID: 87d467e6-fc73-48d5-aafb-c42fec98fd17 with Priority: HIGHEST for action port [ 564.559434] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87d467e6-fc73-48d5-aafb-c42fec98fd17 with Priority: HIGHEST for action port [ 564.559909] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-87d467e6-fc73-48d5-aafb-c42fec98fd17 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 564.559909] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-87d467e6-fc73-48d5-aafb-c42fec98fd17" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 564.559909] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-87d467e6-fc73-48d5-aafb-c42fec98fd17" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 564.560103] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-87d467e6-fc73-48d5-aafb-c42fec98fd17" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 564.560138] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('87d467e6-fc73-48d5-aafb-c42fec98fd17',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 565.063274] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 87d467e6-fc73-48d5-aafb-c42fec98fd17 [ 565.063493] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 565.063626] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 565.063692] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 565.063895] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 565.063977] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 565.064080] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:87d467e6-fc73-48d5-aafb-c42fec98fd17 already deleted. [ 565.064155] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-87d467e6-fc73-48d5-aafb-c42fec98fd17" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 566.289171] env[65065]: INFO networking_nsxv3.common.synchronization [None req-90f3af93-70e1-41ff-bfa3-71ac07215464 None None] Enqueued Resource ID: 94c2bc51-f36c-44ca-9cc9-acb0eb0ae270 with Priority: HIGHEST for action port [ 566.290401] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94c2bc51-f36c-44ca-9cc9-acb0eb0ae270 with Priority: HIGHEST for action port [ 566.291106] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-94c2bc51-f36c-44ca-9cc9-acb0eb0ae270 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 566.292893] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-94c2bc51-f36c-44ca-9cc9-acb0eb0ae270" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 566.292893] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-94c2bc51-f36c-44ca-9cc9-acb0eb0ae270" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 566.292893] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-94c2bc51-f36c-44ca-9cc9-acb0eb0ae270" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 566.292893] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('94c2bc51-f36c-44ca-9cc9-acb0eb0ae270',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 566.796991] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 94c2bc51-f36c-44ca-9cc9-acb0eb0ae270 [ 566.797333] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 566.797577] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 566.797677] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 566.797913] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 566.798024] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 566.798134] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:94c2bc51-f36c-44ca-9cc9-acb0eb0ae270 already deleted. [ 566.798219] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-94c2bc51-f36c-44ca-9cc9-acb0eb0ae270" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 568.421645] env[65065]: INFO networking_nsxv3.common.synchronization [None req-01df0e17-b23e-4ef0-b4d9-1c4a22fd738a None None] Enqueued Resource ID: a431d196-f73b-4af1-8623-9ec68b083c11 with Priority: HIGHEST for action port [ 568.421645] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a431d196-f73b-4af1-8623-9ec68b083c11 with Priority: HIGHEST for action port [ 568.423514] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-a431d196-f73b-4af1-8623-9ec68b083c11 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 568.424550] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a431d196-f73b-4af1-8623-9ec68b083c11" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 568.424550] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a431d196-f73b-4af1-8623-9ec68b083c11" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 568.424550] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a431d196-f73b-4af1-8623-9ec68b083c11" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 568.424550] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a431d196-f73b-4af1-8623-9ec68b083c11',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 568.927907] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a431d196-f73b-4af1-8623-9ec68b083c11 [ 568.927907] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 568.928230] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 568.928230] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 568.928439] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 568.928533] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 568.928629] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a431d196-f73b-4af1-8623-9ec68b083c11 already deleted. [ 568.928719] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a431d196-f73b-4af1-8623-9ec68b083c11" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 570.260988] env[65065]: INFO networking_nsxv3.common.synchronization [None req-b31e5933-8fa1-4d1a-9673-af114e280c3f None None] Enqueued Resource ID: ce8733a1-31d6-4ec7-8a6e-be0692b65f90 with Priority: HIGHEST for action port [ 570.261493] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce8733a1-31d6-4ec7-8a6e-be0692b65f90 with Priority: HIGHEST for action port [ 570.261493] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-ce8733a1-31d6-4ec7-8a6e-be0692b65f90 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 570.261593] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ce8733a1-31d6-4ec7-8a6e-be0692b65f90" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 570.261625] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ce8733a1-31d6-4ec7-8a6e-be0692b65f90" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 570.262918] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ce8733a1-31d6-4ec7-8a6e-be0692b65f90" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 570.262918] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ce8733a1-31d6-4ec7-8a6e-be0692b65f90',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 570.765085] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ce8733a1-31d6-4ec7-8a6e-be0692b65f90 [ 570.765316] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 570.765475] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 570.765531] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 570.765734] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 570.765823] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 570.765917] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ce8733a1-31d6-4ec7-8a6e-be0692b65f90 already deleted. [ 570.765996] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ce8733a1-31d6-4ec7-8a6e-be0692b65f90" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 571.966497] env[65065]: INFO networking_nsxv3.common.synchronization [None req-3e2832cd-5aa9-4cfa-a06c-440cf92eb9a2 None None] Enqueued Resource ID: 2f473b9c-312c-433a-bf7c-e1480e5278b3 with Priority: HIGHEST for action port [ 571.966740] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f473b9c-312c-433a-bf7c-e1480e5278b3 with Priority: HIGHEST for action port [ 571.967350] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-2f473b9c-312c-433a-bf7c-e1480e5278b3 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 571.967488] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2f473b9c-312c-433a-bf7c-e1480e5278b3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 571.967577] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2f473b9c-312c-433a-bf7c-e1480e5278b3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 571.968110] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2f473b9c-312c-433a-bf7c-e1480e5278b3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 571.968110] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2f473b9c-312c-433a-bf7c-e1480e5278b3',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 572.038843] env[65065]: INFO networking_nsxv3.common.synchronization [None req-98ea55b4-aa90-4d29-a771-47abe1a376b1 None None] Enqueued Resource ID: 68f09311-68f5-4846-9f94-08912c7690ab with Priority: HIGHEST for action port [ 572.039168] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68f09311-68f5-4846-9f94-08912c7690ab with Priority: HIGHEST for action port [ 572.039645] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-68f09311-68f5-4846-9f94-08912c7690ab taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.039774] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-68f09311-68f5-4846-9f94-08912c7690ab" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.040177] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-68f09311-68f5-4846-9f94-08912c7690ab" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 572.040537] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-68f09311-68f5-4846-9f94-08912c7690ab" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 572.041319] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('68f09311-68f5-4846-9f94-08912c7690ab',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 572.472473] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2f473b9c-312c-433a-bf7c-e1480e5278b3 [ 572.472473] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.472473] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.472473] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 572.472473] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 572.472473] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 572.472473] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2f473b9c-312c-433a-bf7c-e1480e5278b3 already deleted. [ 572.472473] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2f473b9c-312c-433a-bf7c-e1480e5278b3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 572.542971] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 68f09311-68f5-4846-9f94-08912c7690ab [ 572.543196] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.543329] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.543395] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 572.543608] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 572.543698] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 572.544511] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:68f09311-68f5-4846-9f94-08912c7690ab already deleted. [ 572.545066] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-68f09311-68f5-4846-9f94-08912c7690ab" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 572.936591] env[65065]: INFO networking_nsxv3.common.synchronization [None req-3e3939d0-2f80-40f7-b6aa-58947957ca0f None None] Enqueued Resource ID: a7eedd59-3d05-42cf-9e02-254fef3fecb9 with Priority: HIGHEST for action port [ 572.937181] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7eedd59-3d05-42cf-9e02-254fef3fecb9 with Priority: HIGHEST for action port [ 572.941162] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-a7eedd59-3d05-42cf-9e02-254fef3fecb9 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.941162] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a7eedd59-3d05-42cf-9e02-254fef3fecb9" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.941162] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a7eedd59-3d05-42cf-9e02-254fef3fecb9" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 572.941162] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a7eedd59-3d05-42cf-9e02-254fef3fecb9" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 572.941162] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a7eedd59-3d05-42cf-9e02-254fef3fecb9',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 572.959981] env[65065]: INFO networking_nsxv3.common.synchronization [None req-1ba831d0-8b44-4fe9-9d72-a5700bb6241b None None] Enqueued Resource ID: 44a9e4a5-bc7b-430a-9257-dd447cd5f16f with Priority: HIGHEST for action port [ 572.960158] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44a9e4a5-bc7b-430a-9257-dd447cd5f16f with Priority: HIGHEST for action port [ 572.960684] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-44a9e4a5-bc7b-430a-9257-dd447cd5f16f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.960810] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-44a9e4a5-bc7b-430a-9257-dd447cd5f16f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.960878] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-44a9e4a5-bc7b-430a-9257-dd447cd5f16f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 572.961123] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-44a9e4a5-bc7b-430a-9257-dd447cd5f16f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 572.961205] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('44a9e4a5-bc7b-430a-9257-dd447cd5f16f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 573.445954] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a7eedd59-3d05-42cf-9e02-254fef3fecb9 [ 573.445954] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.445954] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.445954] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.445954] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.445954] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.446656] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a7eedd59-3d05-42cf-9e02-254fef3fecb9 already deleted. [ 573.446656] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a7eedd59-3d05-42cf-9e02-254fef3fecb9" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.465589] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 44a9e4a5-bc7b-430a-9257-dd447cd5f16f [ 573.466107] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.466746] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.466746] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.466746] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.466746] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.467054] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:44a9e4a5-bc7b-430a-9257-dd447cd5f16f already deleted. [ 573.467054] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-44a9e4a5-bc7b-430a-9257-dd447cd5f16f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.306918] env[65065]: INFO networking_nsxv3.common.synchronization [None req-14ed970e-8aa6-4917-8bf1-0d36cb37068a None None] Enqueued Resource ID: 9e7ebe59-e1c2-4b19-87bb-4b32ef36d985 with Priority: HIGHEST for action port [ 574.308165] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e7ebe59-e1c2-4b19-87bb-4b32ef36d985 with Priority: HIGHEST for action port [ 574.308165] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-9e7ebe59-e1c2-4b19-87bb-4b32ef36d985 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.308165] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9e7ebe59-e1c2-4b19-87bb-4b32ef36d985" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.308165] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9e7ebe59-e1c2-4b19-87bb-4b32ef36d985" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.308165] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9e7ebe59-e1c2-4b19-87bb-4b32ef36d985" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.308165] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9e7ebe59-e1c2-4b19-87bb-4b32ef36d985',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 574.815329] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9e7ebe59-e1c2-4b19-87bb-4b32ef36d985 [ 574.815329] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.815329] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.815329] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.815329] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.815329] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.815329] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9e7ebe59-e1c2-4b19-87bb-4b32ef36d985 already deleted. [ 574.815329] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9e7ebe59-e1c2-4b19-87bb-4b32ef36d985" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 575.044250] env[65065]: INFO networking_nsxv3.common.synchronization [None req-c9adcb3d-c7b7-4751-a9a6-58a3841e90ed tempest-ServersTestFqdnHostnames-735698162 tempest-ServersTestFqdnHostnames-735698162-project-member] Enqueued Resource ID: 36775ca6-e5c8-4c23-bad8-a30192db7f3f with Priority: HIGHEST for action security_group_rules [ 575.044250] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 36775ca6-e5c8-4c23-bad8-a30192db7f3f with Priority: HIGHEST for action security_group_rules [ 575.044250] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-36775ca6-e5c8-4c23-bad8-a30192db7f3f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.044701] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-36775ca6-e5c8-4c23-bad8-a30192db7f3f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.044910] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-36775ca6-e5c8-4c23-bad8-a30192db7f3f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.047937] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-36775ca6-e5c8-4c23-bad8-a30192db7f3f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.047937] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('36775ca6-e5c8-4c23-bad8-a30192db7f3f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 575.076464] env[65065]: INFO networking_nsxv3.common.synchronization [None req-8261f564-e6ec-41bf-b4be-51c46b7cdf26 None None] Enqueued Resource ID: fb26468c-0d71-411a-adfd-bc42a605e1e5 with Priority: HIGHEST for action port [ 575.076464] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb26468c-0d71-411a-adfd-bc42a605e1e5 with Priority: HIGHEST for action port [ 575.079320] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-fb26468c-0d71-411a-adfd-bc42a605e1e5 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.079320] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fb26468c-0d71-411a-adfd-bc42a605e1e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.079320] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fb26468c-0d71-411a-adfd-bc42a605e1e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.080411] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fb26468c-0d71-411a-adfd-bc42a605e1e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.080411] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb26468c-0d71-411a-adfd-bc42a605e1e5',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 575.520436] env[65065]: INFO networking_nsxv3.common.synchronization [None req-2d00ebb5-ba37-4efc-9fa5-1644f532c32f None None] Enqueued Resource ID: 4fab829b-9ad9-45a2-be2a-8175ab763066 with Priority: HIGHEST for action port [ 575.520999] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fab829b-9ad9-45a2-be2a-8175ab763066 with Priority: HIGHEST for action port [ 575.521316] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-4fab829b-9ad9-45a2-be2a-8175ab763066 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.521442] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4fab829b-9ad9-45a2-be2a-8175ab763066" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.521511] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4fab829b-9ad9-45a2-be2a-8175ab763066" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.523487] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4fab829b-9ad9-45a2-be2a-8175ab763066" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.523487] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4fab829b-9ad9-45a2-be2a-8175ab763066',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 575.568660] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.568847] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.569510] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.569510] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.569510] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 575.569510] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 36775ca6-e5c8-4c23-bad8-a30192db7f3f already deleted. [ 575.569510] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-36775ca6-e5c8-4c23-bad8-a30192db7f3f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 575.581826] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fb26468c-0d71-411a-adfd-bc42a605e1e5 [ 575.582073] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.582209] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.582246] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.582442] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.582870] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 575.582870] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fb26468c-0d71-411a-adfd-bc42a605e1e5 already deleted. [ 575.582870] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fb26468c-0d71-411a-adfd-bc42a605e1e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.027957] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4fab829b-9ad9-45a2-be2a-8175ab763066 [ 576.028270] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.028270] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.028270] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.028447] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.029387] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.029387] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4fab829b-9ad9-45a2-be2a-8175ab763066 already deleted. [ 576.029387] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4fab829b-9ad9-45a2-be2a-8175ab763066" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.325166] env[65065]: INFO networking_nsxv3.common.synchronization [None req-c245fe44-4c52-4ef6-9c5d-6b5785d7ba93 tempest-ServersTestFqdnHostnames-735698162 tempest-ServersTestFqdnHostnames-735698162-project-member] Enqueued Resource ID: 36775ca6-e5c8-4c23-bad8-a30192db7f3f with Priority: HIGHEST for action security_group_rules [ 576.326191] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 36775ca6-e5c8-4c23-bad8-a30192db7f3f with Priority: HIGHEST for action security_group_rules [ 576.326191] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-36775ca6-e5c8-4c23-bad8-a30192db7f3f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.326191] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-36775ca6-e5c8-4c23-bad8-a30192db7f3f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.326316] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-36775ca6-e5c8-4c23-bad8-a30192db7f3f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.326671] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-36775ca6-e5c8-4c23-bad8-a30192db7f3f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.326671] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('36775ca6-e5c8-4c23-bad8-a30192db7f3f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 576.510633] env[65065]: INFO networking_nsxv3.common.synchronization [None req-95b92bc9-27f4-4f2b-b859-8a1432f74c94 None None] Enqueued Resource ID: 1cee9eaa-e03d-4bea-b485-5b5a135d5d0e with Priority: HIGHEST for action port [ 576.512638] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cee9eaa-e03d-4bea-b485-5b5a135d5d0e with Priority: HIGHEST for action port [ 576.512638] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-1cee9eaa-e03d-4bea-b485-5b5a135d5d0e taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.512638] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1cee9eaa-e03d-4bea-b485-5b5a135d5d0e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.512638] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1cee9eaa-e03d-4bea-b485-5b5a135d5d0e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.512638] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1cee9eaa-e03d-4bea-b485-5b5a135d5d0e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.512638] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1cee9eaa-e03d-4bea-b485-5b5a135d5d0e',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 576.851354] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.852472] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.853996] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.853996] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.853996] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.853996] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 36775ca6-e5c8-4c23-bad8-a30192db7f3f already deleted. [ 576.853996] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-36775ca6-e5c8-4c23-bad8-a30192db7f3f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.014531] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1cee9eaa-e03d-4bea-b485-5b5a135d5d0e [ 577.014643] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.016055] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.016055] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.016055] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.016055] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.016055] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1cee9eaa-e03d-4bea-b485-5b5a135d5d0e already deleted. [ 577.016055] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1cee9eaa-e03d-4bea-b485-5b5a135d5d0e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.502626] env[65065]: INFO networking_nsxv3.common.synchronization [None req-00ed864a-949e-4636-a2c6-03e31a54c0fe None None] Enqueued Resource ID: ddf13a7a-2e82-46da-980b-e379ed25584c with Priority: HIGHEST for action port [ 577.502887] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ddf13a7a-2e82-46da-980b-e379ed25584c with Priority: HIGHEST for action port [ 577.503578] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-ddf13a7a-2e82-46da-980b-e379ed25584c taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.503578] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ddf13a7a-2e82-46da-980b-e379ed25584c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.503730] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ddf13a7a-2e82-46da-980b-e379ed25584c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.503865] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ddf13a7a-2e82-46da-980b-e379ed25584c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.503949] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ddf13a7a-2e82-46da-980b-e379ed25584c',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 578.008189] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ddf13a7a-2e82-46da-980b-e379ed25584c [ 578.008189] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.008189] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.008189] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.008189] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.008189] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.008189] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ddf13a7a-2e82-46da-980b-e379ed25584c already deleted. [ 578.008189] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ddf13a7a-2e82-46da-980b-e379ed25584c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.196922] env[65065]: INFO networking_nsxv3.common.synchronization [None req-055c7dc4-1d6c-4b00-9a52-cce4c9d322e2 None None] Enqueued Resource ID: 23e5e761-772b-47e6-bbe3-14dae6068a44 with Priority: HIGHEST for action port [ 578.196922] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23e5e761-772b-47e6-bbe3-14dae6068a44 with Priority: HIGHEST for action port [ 578.197284] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-23e5e761-772b-47e6-bbe3-14dae6068a44 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.197566] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-23e5e761-772b-47e6-bbe3-14dae6068a44" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.197805] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-23e5e761-772b-47e6-bbe3-14dae6068a44" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.198274] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-23e5e761-772b-47e6-bbe3-14dae6068a44" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.198631] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('23e5e761-772b-47e6-bbe3-14dae6068a44',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 578.701044] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 23e5e761-772b-47e6-bbe3-14dae6068a44 [ 578.701656] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.701656] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.701829] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.702161] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.702456] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.702456] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:23e5e761-772b-47e6-bbe3-14dae6068a44 already deleted. [ 578.702525] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-23e5e761-772b-47e6-bbe3-14dae6068a44" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.106031] env[65065]: INFO networking_nsxv3.common.synchronization [None req-b4475bb2-6d22-4a75-8f66-1ddd7077d168 None None] Enqueued Resource ID: f708d9e1-466d-428a-baf1-cdd768c6cf4c with Priority: HIGHEST for action port [ 579.106031] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f708d9e1-466d-428a-baf1-cdd768c6cf4c with Priority: HIGHEST for action port [ 579.106399] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-f708d9e1-466d-428a-baf1-cdd768c6cf4c taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.106469] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f708d9e1-466d-428a-baf1-cdd768c6cf4c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.106502] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f708d9e1-466d-428a-baf1-cdd768c6cf4c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.107331] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f708d9e1-466d-428a-baf1-cdd768c6cf4c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.107331] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f708d9e1-466d-428a-baf1-cdd768c6cf4c',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 579.609618] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f708d9e1-466d-428a-baf1-cdd768c6cf4c [ 579.609824] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.609824] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.609908] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.611186] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.611186] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.611186] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f708d9e1-466d-428a-baf1-cdd768c6cf4c already deleted. [ 579.611186] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f708d9e1-466d-428a-baf1-cdd768c6cf4c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.777485] env[65065]: INFO networking_nsxv3.common.synchronization [None req-39c81c8a-2d23-4496-8ab6-c07d63a140fc None None] Enqueued Resource ID: 0c80a4c9-7e6f-4936-b901-d90c85e27470 with Priority: HIGHEST for action port [ 579.778044] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c80a4c9-7e6f-4936-b901-d90c85e27470 with Priority: HIGHEST for action port [ 579.778342] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-0c80a4c9-7e6f-4936-b901-d90c85e27470 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.778464] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0c80a4c9-7e6f-4936-b901-d90c85e27470" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.778531] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0c80a4c9-7e6f-4936-b901-d90c85e27470" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.778770] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0c80a4c9-7e6f-4936-b901-d90c85e27470" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.778866] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0c80a4c9-7e6f-4936-b901-d90c85e27470',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 580.289652] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0c80a4c9-7e6f-4936-b901-d90c85e27470 [ 580.289652] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.289652] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.289652] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.289652] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.289652] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.289652] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0c80a4c9-7e6f-4936-b901-d90c85e27470 already deleted. [ 580.289652] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0c80a4c9-7e6f-4936-b901-d90c85e27470" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.843718] env[65065]: INFO networking_nsxv3.common.synchronization [None req-0725b6bf-f37d-4b03-909f-190ef698c307 None None] Enqueued Resource ID: 95aaa5c3-48f4-4536-ac5a-135b3e340ac0 with Priority: HIGHEST for action port [ 580.844223] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95aaa5c3-48f4-4536-ac5a-135b3e340ac0 with Priority: HIGHEST for action port [ 580.844880] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-95aaa5c3-48f4-4536-ac5a-135b3e340ac0 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.844880] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-95aaa5c3-48f4-4536-ac5a-135b3e340ac0" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.845134] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-95aaa5c3-48f4-4536-ac5a-135b3e340ac0" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.845328] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-95aaa5c3-48f4-4536-ac5a-135b3e340ac0" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.845414] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('95aaa5c3-48f4-4536-ac5a-135b3e340ac0',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 581.347879] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 95aaa5c3-48f4-4536-ac5a-135b3e340ac0 [ 581.348013] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.348157] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.348228] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.348489] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.348625] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.348754] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:95aaa5c3-48f4-4536-ac5a-135b3e340ac0 already deleted. [ 581.348900] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-95aaa5c3-48f4-4536-ac5a-135b3e340ac0" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.896019] env[65065]: INFO networking_nsxv3.common.synchronization [None req-ed1968cb-ba14-4203-8194-8fc08fa14654 None None] Enqueued Resource ID: 7a859621-5fb5-4b94-9877-9969e5bcd17a with Priority: HIGHEST for action port [ 581.896019] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a859621-5fb5-4b94-9877-9969e5bcd17a with Priority: HIGHEST for action port [ 581.896019] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-7a859621-5fb5-4b94-9877-9969e5bcd17a taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.896019] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7a859621-5fb5-4b94-9877-9969e5bcd17a" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.896019] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7a859621-5fb5-4b94-9877-9969e5bcd17a" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.897218] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7a859621-5fb5-4b94-9877-9969e5bcd17a" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.897432] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7a859621-5fb5-4b94-9877-9969e5bcd17a',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.401391] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7a859621-5fb5-4b94-9877-9969e5bcd17a [ 582.401624] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.401763] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.401844] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.402064] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.402183] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.402286] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7a859621-5fb5-4b94-9877-9969e5bcd17a already deleted. [ 582.402371] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7a859621-5fb5-4b94-9877-9969e5bcd17a" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.635823] env[65065]: INFO networking_nsxv3.common.synchronization [None req-9c208954-d61d-4ff0-8a2a-2e6608884896 None None] Enqueued Resource ID: 19db62c3-b443-40a4-aca9-abcd4eab6001 with Priority: HIGHEST for action port [ 582.635823] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19db62c3-b443-40a4-aca9-abcd4eab6001 with Priority: HIGHEST for action port [ 582.635823] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-19db62c3-b443-40a4-aca9-abcd4eab6001 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.635823] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-19db62c3-b443-40a4-aca9-abcd4eab6001" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.635823] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-19db62c3-b443-40a4-aca9-abcd4eab6001" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.636771] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-19db62c3-b443-40a4-aca9-abcd4eab6001" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.638391] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('19db62c3-b443-40a4-aca9-abcd4eab6001',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 583.139430] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 19db62c3-b443-40a4-aca9-abcd4eab6001 [ 583.141041] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.141041] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.141041] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.141041] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.141041] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.141041] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:19db62c3-b443-40a4-aca9-abcd4eab6001 already deleted. [ 583.141041] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-19db62c3-b443-40a4-aca9-abcd4eab6001" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.195917] env[65065]: INFO networking_nsxv3.common.synchronization [None req-df909835-bcf5-4a06-b06c-34664255894c None None] Enqueued Resource ID: acfaea1a-4bb3-428f-a87f-05358c293819 with Priority: HIGHEST for action port [ 583.195917] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: acfaea1a-4bb3-428f-a87f-05358c293819 with Priority: HIGHEST for action port [ 583.195917] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-acfaea1a-4bb3-428f-a87f-05358c293819 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.195917] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-acfaea1a-4bb3-428f-a87f-05358c293819" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.195917] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-acfaea1a-4bb3-428f-a87f-05358c293819" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.196802] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-acfaea1a-4bb3-428f-a87f-05358c293819" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.198031] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('acfaea1a-4bb3-428f-a87f-05358c293819',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 583.701182] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port acfaea1a-4bb3-428f-a87f-05358c293819 [ 583.701416] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.701551] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.701620] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.701820] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.701979] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.701979] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:acfaea1a-4bb3-428f-a87f-05358c293819 already deleted. [ 583.702074] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-acfaea1a-4bb3-428f-a87f-05358c293819" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.072190] env[65065]: INFO networking_nsxv3.common.synchronization [None req-c53ad0d8-39f2-42f4-8750-eaafc007b97f None None] Enqueued Resource ID: ca385f63-c910-4f70-8cfd-5e759a9a63ff with Priority: HIGHEST for action port [ 584.073038] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca385f63-c910-4f70-8cfd-5e759a9a63ff with Priority: HIGHEST for action port [ 584.073336] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-ca385f63-c910-4f70-8cfd-5e759a9a63ff taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.073336] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ca385f63-c910-4f70-8cfd-5e759a9a63ff" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.073456] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ca385f63-c910-4f70-8cfd-5e759a9a63ff" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.074399] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ca385f63-c910-4f70-8cfd-5e759a9a63ff" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.074399] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ca385f63-c910-4f70-8cfd-5e759a9a63ff',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.118707] env[65065]: INFO networking_nsxv3.common.synchronization [None req-bfa1cb82-438e-4bd8-b249-3278b8ec9ffb None None] Enqueued Resource ID: ca4e119a-c381-4203-836a-5e346ca816c2 with Priority: HIGHEST for action port [ 584.118974] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca4e119a-c381-4203-836a-5e346ca816c2 with Priority: HIGHEST for action port [ 584.119536] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-ca4e119a-c381-4203-836a-5e346ca816c2 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.119691] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ca4e119a-c381-4203-836a-5e346ca816c2" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.119737] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ca4e119a-c381-4203-836a-5e346ca816c2" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.119954] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ca4e119a-c381-4203-836a-5e346ca816c2" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.120156] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ca4e119a-c381-4203-836a-5e346ca816c2',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.576539] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ca385f63-c910-4f70-8cfd-5e759a9a63ff [ 584.577618] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.577821] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.577903] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.578096] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.578186] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.578280] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ca385f63-c910-4f70-8cfd-5e759a9a63ff already deleted. [ 584.578358] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ca385f63-c910-4f70-8cfd-5e759a9a63ff" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.621984] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ca4e119a-c381-4203-836a-5e346ca816c2 [ 584.622258] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.623776] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.623776] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.623776] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.623776] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.623776] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ca4e119a-c381-4203-836a-5e346ca816c2 already deleted. [ 584.623776] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ca4e119a-c381-4203-836a-5e346ca816c2" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.344827] env[65065]: INFO networking_nsxv3.common.synchronization [None req-cecf1895-dcdc-4cac-9596-d364c795e2c1 None None] Enqueued Resource ID: a0e91035-ede1-44c4-a8c1-c50ef26f1cdc with Priority: HIGHEST for action port [ 585.345815] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0e91035-ede1-44c4-a8c1-c50ef26f1cdc with Priority: HIGHEST for action port [ 585.346394] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-a0e91035-ede1-44c4-a8c1-c50ef26f1cdc taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.346394] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a0e91035-ede1-44c4-a8c1-c50ef26f1cdc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.346394] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a0e91035-ede1-44c4-a8c1-c50ef26f1cdc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.348521] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a0e91035-ede1-44c4-a8c1-c50ef26f1cdc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.348624] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a0e91035-ede1-44c4-a8c1-c50ef26f1cdc',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.443246] env[65065]: INFO networking_nsxv3.common.synchronization [req-484ff63d-23dc-45ad-9cd6-ec924c9dc620 req-3756fce0-c65e-4b6b-8bfe-692596b4f5a9 tempest-ServersAdminNegativeTestJSON-568589506 tempest-ServersAdminNegativeTestJSON-568589506-project-member] Enqueued Resource ID: cc04914d-716e-49e1-8a77-946f904f69bb with Priority: HIGHEST for action security_group_members [ 585.443773] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc04914d-716e-49e1-8a77-946f904f69bb with Priority: HIGHEST for action security_group_members [ 585.447195] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc04914d-716e-49e1-8a77-946f904f69bb taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.447294] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc04914d-716e-49e1-8a77-946f904f69bb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.447328] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc04914d-716e-49e1-8a77-946f904f69bb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.447571] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc04914d-716e-49e1-8a77-946f904f69bb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.447760] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.447869] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.447931] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.448102] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.448187] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.448282] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc04914d-716e-49e1-8a77-946f904f69bb',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.852368] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a0e91035-ede1-44c4-a8c1-c50ef26f1cdc [ 585.852701] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.852887] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.852969] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.855916] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.855916] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.855916] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a0e91035-ede1-44c4-a8c1-c50ef26f1cdc already deleted. [ 585.855916] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a0e91035-ede1-44c4-a8c1-c50ef26f1cdc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.952396] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.952396] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.952396] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.952396] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.952396] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.952925] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.953717] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.953717] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.953717] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.953717] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.953717] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc04914d-716e-49e1-8a77-946f904f69bb already deleted. [ 585.953717] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc04914d-716e-49e1-8a77-946f904f69bb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.148860] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock network-11 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.149073] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "network-11" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.149192] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "network-11" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.149489] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "network-11" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.149748] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.150659] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.150659] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.150803] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.150945] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.151904] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 586.151904] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 586.151904] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 586.151904] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 586.151904] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 586.151904] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 586.152133] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 586.173658] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 586.173834] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 586.174088] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 586.174157] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "network-11" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.174465] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock port-5f34dec9-dc9c-435a-8231-daf43f6e84c2 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.174641] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "port-5f34dec9-dc9c-435a-8231-daf43f6e84c2" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.174749] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "port-5f34dec9-dc9c-435a-8231-daf43f6e84c2" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.175144] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "port-5f34dec9-dc9c-435a-8231-daf43f6e84c2" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.175245] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f34dec9-dc9c-435a-8231-daf43f6e84c2',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.360597] env[65065]: INFO networking_nsxv3.common.synchronization [req-7298d2d9-3c05-411a-a846-cf1dc39b6b41 req-cb8c211d-4161-42db-8d3e-8129785df26f tempest-ServerDiagnosticsTest-42737267 tempest-ServerDiagnosticsTest-42737267-project-member] Enqueued Resource ID: afe348a4-4bdc-4830-8b52-3584e5dee837 with Priority: HIGHEST for action security_group_members [ 586.361836] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: afe348a4-4bdc-4830-8b52-3584e5dee837 with Priority: HIGHEST for action security_group_members [ 586.362735] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-afe348a4-4bdc-4830-8b52-3584e5dee837 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.363799] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-afe348a4-4bdc-4830-8b52-3584e5dee837" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.363799] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-afe348a4-4bdc-4830-8b52-3584e5dee837" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.363799] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-afe348a4-4bdc-4830-8b52-3584e5dee837" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.363799] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.363799] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.364235] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.364235] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.364235] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.364313] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('afe348a4-4bdc-4830-8b52-3584e5dee837',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.677393] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.677659] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.677807] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.678110] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.678261] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.678417] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Segment Port 5f34dec9-dc9c-435a-8231-daf43f6e84c2 not found, creating... [ 586.678678] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.678827] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.679140] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.679256] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.679360] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.679736] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.679853] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.680035] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.683021] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.683021] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.683021] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Resource: SegmentPort with ID: 5f34dec9-dc9c-435a-8231-daf43f6e84c2 is going to be created. [ 586.702613] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.702792] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.702905] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.703212] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.703460] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.703702] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "port-5f34dec9-dc9c-435a-8231-daf43f6e84c2" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.804867] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock network-11 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.805123] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "network-11" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.805264] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "network-11" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.805521] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "network-11" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.805765] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.805938] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.806076] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.806288] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.806423] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.806623] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 586.806739] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 586.806844] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 586.806945] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 586.807058] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 586.807159] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 586.807279] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 586.827677] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 586.827867] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 586.828019] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 586.828321] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "network-11" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.828494] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock port-3820db0d-d762-4457-9956-a824ea5397c2 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.828664] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "port-3820db0d-d762-4457-9956-a824ea5397c2" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.828777] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "port-3820db0d-d762-4457-9956-a824ea5397c2" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.829166] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "port-3820db0d-d762-4457-9956-a824ea5397c2" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.829305] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3820db0d-d762-4457-9956-a824ea5397c2',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.866779] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.867158] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.867158] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.867417] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.867417] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.867512] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.867643] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.867722] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.867885] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.867968] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.868073] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: afe348a4-4bdc-4830-8b52-3584e5dee837 already deleted. [ 586.868156] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-afe348a4-4bdc-4830-8b52-3584e5dee837" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.031775] env[65065]: INFO networking_nsxv3.common.synchronization [None req-42f9c6b5-514d-4987-9029-88b66161fdea None None] Enqueued Resource ID: 91a91690-4010-411c-ba9d-58dc987fecbe with Priority: HIGHEST for action port [ 587.032051] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 91a91690-4010-411c-ba9d-58dc987fecbe with Priority: HIGHEST for action port [ 587.032722] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-91a91690-4010-411c-ba9d-58dc987fecbe taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.032838] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-91a91690-4010-411c-ba9d-58dc987fecbe" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.032903] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-91a91690-4010-411c-ba9d-58dc987fecbe" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.033613] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-91a91690-4010-411c-ba9d-58dc987fecbe" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.033801] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('91a91690-4010-411c-ba9d-58dc987fecbe',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.334383] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.334383] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.334383] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.334383] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.334383] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.334383] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Segment Port 3820db0d-d762-4457-9956-a824ea5397c2 not found, creating... [ 587.334383] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.334383] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.334383] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.334383] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.334383] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.334781] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.334781] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.334781] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.334781] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.334781] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.334781] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Resource: SegmentPort with ID: 3820db0d-d762-4457-9956-a824ea5397c2 is going to be created. [ 587.358385] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.358553] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.358670] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.358941] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.359197] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.359404] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "port-3820db0d-d762-4457-9956-a824ea5397c2" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.526217] env[65065]: INFO networking_nsxv3.common.synchronization [req-484ff63d-23dc-45ad-9cd6-ec924c9dc620 req-2f5190ad-6da5-4dca-9dde-11238c1bd805 service nova] Enqueued Resource ID: cc04914d-716e-49e1-8a77-946f904f69bb with Priority: HIGHEST for action security_group_rules [ 587.526295] env[65065]: INFO networking_nsxv3.common.synchronization [req-484ff63d-23dc-45ad-9cd6-ec924c9dc620 req-2f5190ad-6da5-4dca-9dde-11238c1bd805 service nova] Enqueued Resource ID: cc04914d-716e-49e1-8a77-946f904f69bb with Priority: HIGHEST for action security_group_members [ 587.526374] env[65065]: INFO networking_nsxv3.common.synchronization [req-484ff63d-23dc-45ad-9cd6-ec924c9dc620 req-2f5190ad-6da5-4dca-9dde-11238c1bd805 service nova] Enqueued Resource ID: 5f34dec9-dc9c-435a-8231-daf43f6e84c2 with Priority: HIGHEST for action port [ 587.526953] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc04914d-716e-49e1-8a77-946f904f69bb with Priority: HIGHEST for action security_group_rules [ 587.527337] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc04914d-716e-49e1-8a77-946f904f69bb with Priority: HIGHEST for action security_group_members [ 587.527337] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f34dec9-dc9c-435a-8231-daf43f6e84c2 with Priority: HIGHEST for action port [ 587.527728] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cc04914d-716e-49e1-8a77-946f904f69bb taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.527728] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cc04914d-716e-49e1-8a77-946f904f69bb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.527728] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cc04914d-716e-49e1-8a77-946f904f69bb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.527944] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cc04914d-716e-49e1-8a77-946f904f69bb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.528482] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cc04914d-716e-49e1-8a77-946f904f69bb',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.529335] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc04914d-716e-49e1-8a77-946f904f69bb taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.529404] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc04914d-716e-49e1-8a77-946f904f69bb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.529472] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc04914d-716e-49e1-8a77-946f904f69bb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.529719] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc04914d-716e-49e1-8a77-946f904f69bb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.529792] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.529880] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.529940] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.530102] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.530831] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.530949] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc04914d-716e-49e1-8a77-946f904f69bb',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.532074] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-5f34dec9-dc9c-435a-8231-daf43f6e84c2 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.532182] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5f34dec9-dc9c-435a-8231-daf43f6e84c2" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.534520] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5f34dec9-dc9c-435a-8231-daf43f6e84c2" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.534520] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5f34dec9-dc9c-435a-8231-daf43f6e84c2" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.534520] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f34dec9-dc9c-435a-8231-daf43f6e84c2',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.536359] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 91a91690-4010-411c-ba9d-58dc987fecbe [ 587.536550] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.536680] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.538420] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.538420] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.538420] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.538420] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:91a91690-4010-411c-ba9d-58dc987fecbe already deleted. [ 587.538420] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-91a91690-4010-411c-ba9d-58dc987fecbe" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.640875] env[65065]: INFO networking_nsxv3.common.synchronization [None req-31041b7c-7536-4027-9cdf-7c7931962df2 None None] Enqueued Resource ID: 28ecd80b-48b1-4f81-99c0-fb1d11c06156 with Priority: HIGHEST for action port [ 587.641624] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28ecd80b-48b1-4f81-99c0-fb1d11c06156 with Priority: HIGHEST for action port [ 587.641987] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-28ecd80b-48b1-4f81-99c0-fb1d11c06156 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.642169] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-28ecd80b-48b1-4f81-99c0-fb1d11c06156" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.642256] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-28ecd80b-48b1-4f81-99c0-fb1d11c06156" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.642561] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-28ecd80b-48b1-4f81-99c0-fb1d11c06156" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.642612] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('28ecd80b-48b1-4f81-99c0-fb1d11c06156',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.034906] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc04914d-716e-49e1-8a77-946f904f69bb taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.035181] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc04914d-716e-49e1-8a77-946f904f69bb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.047483] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5f34dec9-dc9c-435a-8231-daf43f6e84c2 with status ACTIVE [ 588.047483] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.048131] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.048131] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.048131] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.048256] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.048333] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.048441] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.048483] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.048766] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.048766] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.048891] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.048964] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.049041] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.049178] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.049247] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.049325] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5f34dec9-dc9c-435a-8231-daf43f6e84c2 is going to be updated. [ 588.051844] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cc04914d-716e-49e1-8a77-946f904f69bb',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.080627] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.080627] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.080627] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.080627] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.080627] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.080627] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5f34dec9-dc9c-435a-8231-daf43f6e84c2" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.147708] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 28ecd80b-48b1-4f81-99c0-fb1d11c06156 [ 588.147708] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.147708] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.147708] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.147708] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.147708] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.147708] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:28ecd80b-48b1-4f81-99c0-fb1d11c06156 already deleted. [ 588.147708] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-28ecd80b-48b1-4f81-99c0-fb1d11c06156" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.212445] env[65065]: INFO networking_nsxv3.common.synchronization [req-7298d2d9-3c05-411a-a846-cf1dc39b6b41 req-df7d0d10-8377-4d09-8600-15d855b3e20a service nova] Enqueued Resource ID: afe348a4-4bdc-4830-8b52-3584e5dee837 with Priority: HIGHEST for action security_group_rules [ 588.212445] env[65065]: INFO networking_nsxv3.common.synchronization [req-7298d2d9-3c05-411a-a846-cf1dc39b6b41 req-df7d0d10-8377-4d09-8600-15d855b3e20a service nova] Enqueued Resource ID: afe348a4-4bdc-4830-8b52-3584e5dee837 with Priority: HIGHEST for action security_group_members [ 588.212445] env[65065]: INFO networking_nsxv3.common.synchronization [req-7298d2d9-3c05-411a-a846-cf1dc39b6b41 req-df7d0d10-8377-4d09-8600-15d855b3e20a service nova] Enqueued Resource ID: 3820db0d-d762-4457-9956-a824ea5397c2 with Priority: HIGHEST for action port [ 588.212802] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: afe348a4-4bdc-4830-8b52-3584e5dee837 with Priority: HIGHEST for action security_group_rules [ 588.212967] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: afe348a4-4bdc-4830-8b52-3584e5dee837 with Priority: HIGHEST for action security_group_members [ 588.213358] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3820db0d-d762-4457-9956-a824ea5397c2 with Priority: HIGHEST for action port [ 588.213679] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-afe348a4-4bdc-4830-8b52-3584e5dee837 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.213829] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-afe348a4-4bdc-4830-8b52-3584e5dee837" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.213898] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-afe348a4-4bdc-4830-8b52-3584e5dee837" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.214169] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-afe348a4-4bdc-4830-8b52-3584e5dee837" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.214254] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('afe348a4-4bdc-4830-8b52-3584e5dee837',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.215239] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-afe348a4-4bdc-4830-8b52-3584e5dee837 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.216592] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-afe348a4-4bdc-4830-8b52-3584e5dee837" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.216740] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-afe348a4-4bdc-4830-8b52-3584e5dee837" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.216942] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-afe348a4-4bdc-4830-8b52-3584e5dee837" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.217447] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.217447] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.217447] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.217597] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.218063] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.218560] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('afe348a4-4bdc-4830-8b52-3584e5dee837',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.219272] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-3820db0d-d762-4457-9956-a824ea5397c2 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.219272] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3820db0d-d762-4457-9956-a824ea5397c2" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.219567] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3820db0d-d762-4457-9956-a824ea5397c2" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.219567] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3820db0d-d762-4457-9956-a824ea5397c2" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.219567] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3820db0d-d762-4457-9956-a824ea5397c2',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.546724] env[65065]: INFO networking_nsxv3.common.synchronization [None req-c8dea93f-115e-4ee4-a436-bff8cbecfd47 None None] Enqueued Resource ID: fea2371f-2407-414a-890e-d0f62074ab7a with Priority: HIGHEST for action port [ 588.548596] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fea2371f-2407-414a-890e-d0f62074ab7a with Priority: HIGHEST for action port [ 588.550522] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-fea2371f-2407-414a-890e-d0f62074ab7a taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.550652] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fea2371f-2407-414a-890e-d0f62074ab7a" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.550978] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fea2371f-2407-414a-890e-d0f62074ab7a" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.550978] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fea2371f-2407-414a-890e-d0f62074ab7a" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.551142] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fea2371f-2407-414a-890e-d0f62074ab7a',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.558100] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cc04914d-716e-49e1-8a77-946f904f69bb',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.662277] env[65065]: INFO networking_nsxv3.common.synchronization [req-bc89934e-9ab3-425c-babf-49fc8a7cfff1 req-eea1e78a-bbb8-4e30-a8ab-d6010d46801d tempest-DeleteServersAdminTestJSON-854701151 tempest-DeleteServersAdminTestJSON-854701151-project-member] Enqueued Resource ID: 5501386c-6d40-4911-b095-561660dd038b with Priority: HIGHEST for action security_group_members [ 588.662277] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5501386c-6d40-4911-b095-561660dd038b with Priority: HIGHEST for action security_group_members [ 588.664682] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-5501386c-6d40-4911-b095-561660dd038b taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.664682] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5501386c-6d40-4911-b095-561660dd038b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.664682] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5501386c-6d40-4911-b095-561660dd038b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.664682] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5501386c-6d40-4911-b095-561660dd038b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.664682] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.664682] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.664682] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.664682] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.664682] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.664682] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5501386c-6d40-4911-b095-561660dd038b',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.722312] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('afe348a4-4bdc-4830-8b52-3584e5dee837',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.723359] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-afe348a4-4bdc-4830-8b52-3584e5dee837 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.723473] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-afe348a4-4bdc-4830-8b52-3584e5dee837" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.723614] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3820db0d-d762-4457-9956-a824ea5397c2 with status ACTIVE [ 588.723810] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.723915] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.723977] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.724188] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.724280] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.724435] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.724524] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.724582] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.724734] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.724807] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.724981] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.729313] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.730860] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.730860] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.730860] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.730860] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3820db0d-d762-4457-9956-a824ea5397c2 is going to be updated. [ 588.755607] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.759302] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.759389] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.760885] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.760885] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.760885] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3820db0d-d762-4457-9956-a824ea5397c2" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.977797] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock network-11 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.978025] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "network-11" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.978145] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "network-11" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.978666] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "network-11" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.978746] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.978834] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.978942] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.979166] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.979310] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.979503] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 588.980312] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 588.980312] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 588.980312] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 588.980312] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 588.980312] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 588.980312] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 588.999215] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 588.999398] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 589.001012] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 589.001012] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "network-11" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.001012] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock port-03382bc1-a2a4-4f18-8ca4-2d39a1473883 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.001012] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "port-03382bc1-a2a4-4f18-8ca4-2d39a1473883" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.001012] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "port-03382bc1-a2a4-4f18-8ca4-2d39a1473883" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.001012] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "port-03382bc1-a2a4-4f18-8ca4-2d39a1473883" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.001012] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('03382bc1-a2a4-4f18-8ca4-2d39a1473883',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.054347] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fea2371f-2407-414a-890e-d0f62074ab7a [ 589.054347] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.054347] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.055506] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.055506] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.055506] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.055506] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fea2371f-2407-414a-890e-d0f62074ab7a already deleted. [ 589.055506] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fea2371f-2407-414a-890e-d0f62074ab7a" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.063213] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.063414] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.063414] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.063626] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.063851] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.063851] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc04914d-716e-49e1-8a77-946f904f69bb is going to be created. [ 589.097296] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.097509] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.097509] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.097703] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.098031] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.112125] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc04914d-716e-49e1-8a77-946f904f69bb in Status: UNINITIALIZED for 2s [ 589.166275] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.167377] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.167377] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.167377] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.167377] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.167564] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.167620] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.167664] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.168027] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.168145] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.168253] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5501386c-6d40-4911-b095-561660dd038b already deleted. [ 589.168353] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5501386c-6d40-4911-b095-561660dd038b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.234352] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('afe348a4-4bdc-4830-8b52-3584e5dee837',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.510384] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.510384] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.510384] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.510384] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.510384] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.510384] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Segment Port 03382bc1-a2a4-4f18-8ca4-2d39a1473883 not found, creating... [ 589.510384] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.510384] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.510384] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.510384] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.510384] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.510834] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.510834] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.510834] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.510834] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.510834] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.510834] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Resource: SegmentPort with ID: 03382bc1-a2a4-4f18-8ca4-2d39a1473883 is going to be created. [ 589.518303] env[65065]: INFO networking_nsxv3.common.synchronization [None req-9af08239-7c85-494b-ad0c-d37562d23a51 None None] Enqueued Resource ID: 0a455c20-f601-44ec-a3fa-cb7cf8d0c988 with Priority: HIGHEST for action port [ 589.518853] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a455c20-f601-44ec-a3fa-cb7cf8d0c988 with Priority: HIGHEST for action port [ 589.519397] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-0a455c20-f601-44ec-a3fa-cb7cf8d0c988 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.519576] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0a455c20-f601-44ec-a3fa-cb7cf8d0c988" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.519699] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0a455c20-f601-44ec-a3fa-cb7cf8d0c988" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.520238] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0a455c20-f601-44ec-a3fa-cb7cf8d0c988" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.520238] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0a455c20-f601-44ec-a3fa-cb7cf8d0c988',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.532115] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.532358] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.532504] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.532889] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.533266] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.533672] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "port-03382bc1-a2a4-4f18-8ca4-2d39a1473883" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.741106] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.742432] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.742432] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.742432] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.742432] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.742432] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: afe348a4-4bdc-4830-8b52-3584e5dee837 is going to be created. [ 589.767996] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.768196] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.768239] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.768419] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.769656] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.781193] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: afe348a4-4bdc-4830-8b52-3584e5dee837 in Status: UNINITIALIZED for 2s [ 590.022513] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0a455c20-f601-44ec-a3fa-cb7cf8d0c988 [ 590.022729] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.022857] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.022923] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.023158] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.023248] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.023332] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0a455c20-f601-44ec-a3fa-cb7cf8d0c988 already deleted. [ 590.023407] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0a455c20-f601-44ec-a3fa-cb7cf8d0c988" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.340112] env[65065]: INFO networking_nsxv3.common.synchronization [req-bc89934e-9ab3-425c-babf-49fc8a7cfff1 req-11c15df5-dcaa-4929-b8e2-19849e8e4893 service nova] Enqueued Resource ID: 5501386c-6d40-4911-b095-561660dd038b with Priority: HIGHEST for action security_group_rules [ 590.340387] env[65065]: INFO networking_nsxv3.common.synchronization [req-bc89934e-9ab3-425c-babf-49fc8a7cfff1 req-11c15df5-dcaa-4929-b8e2-19849e8e4893 service nova] Enqueued Resource ID: 5501386c-6d40-4911-b095-561660dd038b with Priority: HIGHEST for action security_group_members [ 590.340424] env[65065]: INFO networking_nsxv3.common.synchronization [req-bc89934e-9ab3-425c-babf-49fc8a7cfff1 req-11c15df5-dcaa-4929-b8e2-19849e8e4893 service nova] Enqueued Resource ID: 03382bc1-a2a4-4f18-8ca4-2d39a1473883 with Priority: HIGHEST for action port [ 590.340963] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5501386c-6d40-4911-b095-561660dd038b with Priority: HIGHEST for action security_group_rules [ 590.343504] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5501386c-6d40-4911-b095-561660dd038b with Priority: HIGHEST for action security_group_members [ 590.344114] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03382bc1-a2a4-4f18-8ca4-2d39a1473883 with Priority: HIGHEST for action port [ 590.344114] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5501386c-6d40-4911-b095-561660dd038b taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.344114] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5501386c-6d40-4911-b095-561660dd038b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.344114] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5501386c-6d40-4911-b095-561660dd038b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.344385] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5501386c-6d40-4911-b095-561660dd038b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.344465] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5501386c-6d40-4911-b095-561660dd038b',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.345934] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-5501386c-6d40-4911-b095-561660dd038b taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.345934] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5501386c-6d40-4911-b095-561660dd038b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.345934] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5501386c-6d40-4911-b095-561660dd038b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.346124] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5501386c-6d40-4911-b095-561660dd038b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.346124] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.346349] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.346349] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.346447] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.346505] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.346599] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5501386c-6d40-4911-b095-561660dd038b',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.347750] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-03382bc1-a2a4-4f18-8ca4-2d39a1473883 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.348470] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-03382bc1-a2a4-4f18-8ca4-2d39a1473883" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.348470] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-03382bc1-a2a4-4f18-8ca4-2d39a1473883" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.348470] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-03382bc1-a2a4-4f18-8ca4-2d39a1473883" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.348470] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('03382bc1-a2a4-4f18-8ca4-2d39a1473883',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.512275] env[65065]: INFO networking_nsxv3.common.synchronization [None req-9b5d1c18-16ef-4512-b5a7-9e0555824452 None None] Enqueued Resource ID: b6e73db6-3975-4846-bf17-dda7d90adb13 with Priority: HIGHEST for action port [ 590.512797] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6e73db6-3975-4846-bf17-dda7d90adb13 with Priority: HIGHEST for action port [ 590.513516] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-b6e73db6-3975-4846-bf17-dda7d90adb13 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.513516] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b6e73db6-3975-4846-bf17-dda7d90adb13" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.513516] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b6e73db6-3975-4846-bf17-dda7d90adb13" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.514416] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b6e73db6-3975-4846-bf17-dda7d90adb13" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.514416] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b6e73db6-3975-4846-bf17-dda7d90adb13',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.852451] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-5501386c-6d40-4911-b095-561660dd038b taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.852451] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5501386c-6d40-4911-b095-561660dd038b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.852451] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5501386c-6d40-4911-b095-561660dd038b',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.855902] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 03382bc1-a2a4-4f18-8ca4-2d39a1473883 with status ACTIVE [ 590.855902] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.855902] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.855902] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.855902] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.855902] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.855902] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.855902] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.855902] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.855902] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.855902] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.855902] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.855902] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.855902] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.855902] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.855902] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.855902] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 03382bc1-a2a4-4f18-8ca4-2d39a1473883 is going to be updated. [ 590.881351] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.884724] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.884724] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.884724] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.884724] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.884724] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-03382bc1-a2a4-4f18-8ca4-2d39a1473883" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.017038] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b6e73db6-3975-4846-bf17-dda7d90adb13 [ 591.017374] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.017374] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.017517] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.017601] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.017690] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.017803] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b6e73db6-3975-4846-bf17-dda7d90adb13 already deleted. [ 591.017892] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b6e73db6-3975-4846-bf17-dda7d90adb13" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.124403] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc04914d-716e-49e1-8a77-946f904f69bb in Status: SUCCESS [ 591.124680] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc04914d-716e-49e1-8a77-946f904f69bb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.124886] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc04914d-716e-49e1-8a77-946f904f69bb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.125132] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc04914d-716e-49e1-8a77-946f904f69bb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.126383] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.126383] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.126383] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.126383] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.126383] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.126383] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc04914d-716e-49e1-8a77-946f904f69bb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.126383] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cc04914d-716e-49e1-8a77-946f904f69bb',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.359419] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5501386c-6d40-4911-b095-561660dd038b',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.467796] env[65065]: INFO networking_nsxv3.common.synchronization [None req-1da9157e-c58c-4ddc-9f1e-0340ce02a8cc None None] Enqueued Resource ID: 48316514-7f81-412d-b83e-103ecc07c361 with Priority: HIGHEST for action port [ 591.467796] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48316514-7f81-412d-b83e-103ecc07c361 with Priority: HIGHEST for action port [ 591.467796] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-48316514-7f81-412d-b83e-103ecc07c361 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.467796] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-48316514-7f81-412d-b83e-103ecc07c361" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.467796] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-48316514-7f81-412d-b83e-103ecc07c361" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.467796] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-48316514-7f81-412d-b83e-103ecc07c361" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.467796] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('48316514-7f81-412d-b83e-103ecc07c361',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.541773] env[65065]: INFO networking_nsxv3.common.synchronization [req-fe6915c5-5e5a-4aa2-b68e-847edaa8389d req-70711ada-db83-4997-9480-25d0b0465210 tempest-ServerExternalEventsTest-1266274393 tempest-ServerExternalEventsTest-1266274393-project-member] Enqueued Resource ID: 45d9fbda-3bbf-490e-af96-b968c92e95ba with Priority: HIGHEST for action security_group_members [ 591.542751] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45d9fbda-3bbf-490e-af96-b968c92e95ba with Priority: HIGHEST for action security_group_members [ 591.542751] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-45d9fbda-3bbf-490e-af96-b968c92e95ba taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.542751] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45d9fbda-3bbf-490e-af96-b968c92e95ba" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.542751] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45d9fbda-3bbf-490e-af96-b968c92e95ba" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.545768] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45d9fbda-3bbf-490e-af96-b968c92e95ba" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.545768] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.545768] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.545768] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.545768] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.545768] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.546981] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('45d9fbda-3bbf-490e-af96-b968c92e95ba',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.633088] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc04914d-716e-49e1-8a77-946f904f69bb taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.633088] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc04914d-716e-49e1-8a77-946f904f69bb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.633088] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc04914d-716e-49e1-8a77-946f904f69bb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.633088] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc04914d-716e-49e1-8a77-946f904f69bb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.633088] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.633088] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.633088] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.633088] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.633088] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.633088] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc04914d-716e-49e1-8a77-946f904f69bb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.633088] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc04914d-716e-49e1-8a77-946f904f69bb taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.633088] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc04914d-716e-49e1-8a77-946f904f69bb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.633088] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc04914d-716e-49e1-8a77-946f904f69bb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.633088] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc04914d-716e-49e1-8a77-946f904f69bb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.633088] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.633088] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.633658] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.633658] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.633658] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.633658] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc04914d-716e-49e1-8a77-946f904f69bb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.633658] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cc04914d-716e-49e1-8a77-946f904f69bb',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.794813] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: afe348a4-4bdc-4830-8b52-3584e5dee837 in Status: UNINITIALIZED for 4s [ 591.868294] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.868294] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.868294] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.868294] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.868294] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.868294] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5501386c-6d40-4911-b095-561660dd038b is going to be created. [ 591.894321] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock network-11 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.894321] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "network-11" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.894321] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "network-11" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.894457] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "network-11" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.894761] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.895087] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.895087] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.895685] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.895845] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.896057] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 591.896168] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 591.896478] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 591.896590] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 591.896710] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 591.896913] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 591.897034] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 591.899948] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.900097] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.900167] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.900335] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.900557] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.921362] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5501386c-6d40-4911-b095-561660dd038b in Status: UNINITIALIZED for 2s [ 591.932753] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 591.932920] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Cache value generated in 0.036 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 591.933064] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 591.933238] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "network-11" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.933567] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock port-34f9d792-cf77-4944-8bce-15318d4d49c3 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.933738] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "port-34f9d792-cf77-4944-8bce-15318d4d49c3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.933851] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "port-34f9d792-cf77-4944-8bce-15318d4d49c3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.934305] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "port-34f9d792-cf77-4944-8bce-15318d4d49c3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.935440] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('34f9d792-cf77-4944-8bce-15318d4d49c3',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.969260] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 48316514-7f81-412d-b83e-103ecc07c361 [ 591.969260] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.969260] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.969260] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.969260] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.969260] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.969260] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:48316514-7f81-412d-b83e-103ecc07c361 already deleted. [ 591.970214] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-48316514-7f81-412d-b83e-103ecc07c361" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.048900] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.052098] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.052098] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.052098] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.052098] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.052098] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.052098] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.052098] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.052098] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.052098] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.052098] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45d9fbda-3bbf-490e-af96-b968c92e95ba already deleted. [ 592.052098] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45d9fbda-3bbf-490e-af96-b968c92e95ba" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.136479] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cc04914d-716e-49e1-8a77-946f904f69bb: rpc.has_security_group_logging(os_id): False [ 592.157597] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.157597] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.157597] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.157597] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.157597] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.157597] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.157597] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.157597] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.157597] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.157597] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.158139] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.158139] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.158139] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.158561] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.158618] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.158862] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.159067] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.159556] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.159556] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.159556] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.159556] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cc04914d-716e-49e1-8a77-946f904f69bb is going to be created. [ 592.251852] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.251852] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.252059] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.252505] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.252701] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.264821] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cc04914d-716e-49e1-8a77-946f904f69bb in Status: IN_PROGRESS for 2s [ 592.288878] env[65065]: INFO networking_nsxv3.common.synchronization [None req-46d149b8-6b4a-4b81-ae9b-3f4a081135f2 tempest-VolumesAssistedSnapshotsTest-1337089844 tempest-VolumesAssistedSnapshotsTest-1337089844-project-member] Enqueued Resource ID: d38273aa-e7d2-4aea-bcb1-2f5ae899e71f with Priority: HIGHEST for action security_group_rules [ 592.289600] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d38273aa-e7d2-4aea-bcb1-2f5ae899e71f with Priority: HIGHEST for action security_group_rules [ 592.289936] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d38273aa-e7d2-4aea-bcb1-2f5ae899e71f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.290889] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d38273aa-e7d2-4aea-bcb1-2f5ae899e71f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.290889] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d38273aa-e7d2-4aea-bcb1-2f5ae899e71f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.290889] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d38273aa-e7d2-4aea-bcb1-2f5ae899e71f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.290889] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d38273aa-e7d2-4aea-bcb1-2f5ae899e71f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.439242] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.439664] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.439664] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.439913] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.440071] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.440224] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Segment Port 34f9d792-cf77-4944-8bce-15318d4d49c3 not found, creating... [ 592.440490] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.440674] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.440781] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.441016] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.441168] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.441472] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.441576] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.441682] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.441930] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.443385] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.443385] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Resource: SegmentPort with ID: 34f9d792-cf77-4944-8bce-15318d4d49c3 is going to be created. [ 592.465322] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.465572] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.466259] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.466259] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.466259] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.466508] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "port-34f9d792-cf77-4944-8bce-15318d4d49c3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.546166] env[65065]: INFO networking_nsxv3.common.synchronization [None req-a4455f9f-1a80-4d4c-aeb4-92e1a7d93127 tempest-VolumesAssistedSnapshotsTest-1337089844 tempest-VolumesAssistedSnapshotsTest-1337089844-project-member] Enqueued Resource ID: d38273aa-e7d2-4aea-bcb1-2f5ae899e71f with Priority: HIGHEST for action security_group_rules [ 592.546827] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d38273aa-e7d2-4aea-bcb1-2f5ae899e71f with Priority: HIGHEST for action security_group_rules [ 592.546979] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d38273aa-e7d2-4aea-bcb1-2f5ae899e71f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.547264] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d38273aa-e7d2-4aea-bcb1-2f5ae899e71f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.811373] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.811544] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.811621] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.811837] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.811930] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.812040] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d38273aa-e7d2-4aea-bcb1-2f5ae899e71f already deleted. [ 592.812125] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d38273aa-e7d2-4aea-bcb1-2f5ae899e71f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.812268] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d38273aa-e7d2-4aea-bcb1-2f5ae899e71f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.812422] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d38273aa-e7d2-4aea-bcb1-2f5ae899e71f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.812507] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d38273aa-e7d2-4aea-bcb1-2f5ae899e71f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.158456] env[65065]: INFO networking_nsxv3.common.synchronization [req-fe6915c5-5e5a-4aa2-b68e-847edaa8389d req-5f6628b4-5747-4663-bfd9-a09ef16862c5 service nova] Enqueued Resource ID: 45d9fbda-3bbf-490e-af96-b968c92e95ba with Priority: HIGHEST for action security_group_rules [ 593.158456] env[65065]: INFO networking_nsxv3.common.synchronization [req-fe6915c5-5e5a-4aa2-b68e-847edaa8389d req-5f6628b4-5747-4663-bfd9-a09ef16862c5 service nova] Enqueued Resource ID: 45d9fbda-3bbf-490e-af96-b968c92e95ba with Priority: HIGHEST for action security_group_members [ 593.158456] env[65065]: INFO networking_nsxv3.common.synchronization [req-fe6915c5-5e5a-4aa2-b68e-847edaa8389d req-5f6628b4-5747-4663-bfd9-a09ef16862c5 service nova] Enqueued Resource ID: 34f9d792-cf77-4944-8bce-15318d4d49c3 with Priority: HIGHEST for action port [ 593.158952] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45d9fbda-3bbf-490e-af96-b968c92e95ba with Priority: HIGHEST for action security_group_rules [ 593.159132] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45d9fbda-3bbf-490e-af96-b968c92e95ba with Priority: HIGHEST for action security_group_members [ 593.159235] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34f9d792-cf77-4944-8bce-15318d4d49c3 with Priority: HIGHEST for action port [ 593.159511] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-45d9fbda-3bbf-490e-af96-b968c92e95ba taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.159631] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-45d9fbda-3bbf-490e-af96-b968c92e95ba" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.159696] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-45d9fbda-3bbf-490e-af96-b968c92e95ba" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.159951] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-45d9fbda-3bbf-490e-af96-b968c92e95ba" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.160039] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('45d9fbda-3bbf-490e-af96-b968c92e95ba',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.161209] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-45d9fbda-3bbf-490e-af96-b968c92e95ba taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.161323] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45d9fbda-3bbf-490e-af96-b968c92e95ba" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.161400] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45d9fbda-3bbf-490e-af96-b968c92e95ba" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.161567] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45d9fbda-3bbf-490e-af96-b968c92e95ba" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.161714] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.161807] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.161868] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.162064] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.162098] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.162260] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('45d9fbda-3bbf-490e-af96-b968c92e95ba',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.162884] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-34f9d792-cf77-4944-8bce-15318d4d49c3 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.162996] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-34f9d792-cf77-4944-8bce-15318d4d49c3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.163088] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-34f9d792-cf77-4944-8bce-15318d4d49c3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.163235] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-34f9d792-cf77-4944-8bce-15318d4d49c3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.163311] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('34f9d792-cf77-4944-8bce-15318d4d49c3',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.336126] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.336484] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.336605] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.336940] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.337052] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.337208] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d38273aa-e7d2-4aea-bcb1-2f5ae899e71f already deleted. [ 593.337328] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d38273aa-e7d2-4aea-bcb1-2f5ae899e71f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.665199] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('45d9fbda-3bbf-490e-af96-b968c92e95ba',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.666704] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-45d9fbda-3bbf-490e-af96-b968c92e95ba taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.666704] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45d9fbda-3bbf-490e-af96-b968c92e95ba" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.666704] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 34f9d792-cf77-4944-8bce-15318d4d49c3 with status ACTIVE [ 593.667071] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.667071] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.667071] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.667487] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.667487] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.667566] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.667621] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.667653] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.667851] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.667911] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.668139] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.668139] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.668833] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.668833] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.668833] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.668833] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 34f9d792-cf77-4944-8bce-15318d4d49c3 is going to be updated. [ 593.689927] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.689927] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.689927] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.689927] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.689927] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.689927] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-34f9d792-cf77-4944-8bce-15318d4d49c3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.808877] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: afe348a4-4bdc-4830-8b52-3584e5dee837 in Status: SUCCESS [ 593.808877] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-afe348a4-4bdc-4830-8b52-3584e5dee837" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.808877] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-afe348a4-4bdc-4830-8b52-3584e5dee837" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.808877] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-afe348a4-4bdc-4830-8b52-3584e5dee837" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.808877] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.808877] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.808877] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.809275] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.809275] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.809275] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-afe348a4-4bdc-4830-8b52-3584e5dee837" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.809472] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('afe348a4-4bdc-4830-8b52-3584e5dee837',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.932442] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5501386c-6d40-4911-b095-561660dd038b in Status: SUCCESS [ 593.932697] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5501386c-6d40-4911-b095-561660dd038b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.933080] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5501386c-6d40-4911-b095-561660dd038b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.933288] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5501386c-6d40-4911-b095-561660dd038b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.934131] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.934131] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.934131] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.934131] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.934131] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.934131] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5501386c-6d40-4911-b095-561660dd038b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.934463] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5501386c-6d40-4911-b095-561660dd038b',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.167214] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('45d9fbda-3bbf-490e-af96-b968c92e95ba',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.278633] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cc04914d-716e-49e1-8a77-946f904f69bb in Status: SUCCESS [ 594.279307] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cc04914d-716e-49e1-8a77-946f904f69bb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.313089] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-afe348a4-4bdc-4830-8b52-3584e5dee837 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.315412] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-afe348a4-4bdc-4830-8b52-3584e5dee837" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.315412] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-afe348a4-4bdc-4830-8b52-3584e5dee837" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.315412] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-afe348a4-4bdc-4830-8b52-3584e5dee837" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.315412] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.315412] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.315412] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.315412] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.315412] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.315412] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-afe348a4-4bdc-4830-8b52-3584e5dee837" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.315412] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-afe348a4-4bdc-4830-8b52-3584e5dee837 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.315412] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-afe348a4-4bdc-4830-8b52-3584e5dee837" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.315412] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-afe348a4-4bdc-4830-8b52-3584e5dee837" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.315412] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-afe348a4-4bdc-4830-8b52-3584e5dee837" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.315412] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.315412] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.315412] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.315412] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.315956] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.315956] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-afe348a4-4bdc-4830-8b52-3584e5dee837" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.315956] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('afe348a4-4bdc-4830-8b52-3584e5dee837',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.437431] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-5501386c-6d40-4911-b095-561660dd038b taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.437431] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5501386c-6d40-4911-b095-561660dd038b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.437431] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5501386c-6d40-4911-b095-561660dd038b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.437431] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5501386c-6d40-4911-b095-561660dd038b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.437431] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.437744] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.437744] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.437744] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.437869] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.437869] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5501386c-6d40-4911-b095-561660dd038b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.438047] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-5501386c-6d40-4911-b095-561660dd038b taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.438109] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5501386c-6d40-4911-b095-561660dd038b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.438178] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5501386c-6d40-4911-b095-561660dd038b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.438319] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5501386c-6d40-4911-b095-561660dd038b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.438451] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.438560] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.438621] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.438757] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.438833] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.438900] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5501386c-6d40-4911-b095-561660dd038b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.438983] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5501386c-6d40-4911-b095-561660dd038b',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.671677] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.671992] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.671992] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.673091] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.673091] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.673091] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45d9fbda-3bbf-490e-af96-b968c92e95ba is going to be created. [ 594.696465] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.696699] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.696798] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.697599] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.697820] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.707693] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45d9fbda-3bbf-490e-af96-b968c92e95ba in Status: UNINITIALIZED for 2s [ 594.723037] env[65065]: INFO networking_nsxv3.common.synchronization [None req-e5a9187b-88f8-4d94-9a71-b6da52cba294 None None] Enqueued Resource ID: f1104d25-6222-4924-b9c7-b33559b1415d with Priority: HIGHEST for action port [ 594.723037] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1104d25-6222-4924-b9c7-b33559b1415d with Priority: HIGHEST for action port [ 594.723125] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-f1104d25-6222-4924-b9c7-b33559b1415d taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.723230] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f1104d25-6222-4924-b9c7-b33559b1415d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.723270] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f1104d25-6222-4924-b9c7-b33559b1415d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.723517] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f1104d25-6222-4924-b9c7-b33559b1415d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.723769] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f1104d25-6222-4924-b9c7-b33559b1415d',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.818706] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for afe348a4-4bdc-4830-8b52-3584e5dee837: rpc.has_security_group_logging(os_id): False [ 594.838107] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.838268] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.838875] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.838875] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.838875] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.838875] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.838875] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.839070] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.839070] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.839135] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.839328] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.839428] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.839478] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.839635] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.839677] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.839854] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.839919] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.839983] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.844034] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.844124] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.844272] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: afe348a4-4bdc-4830-8b52-3584e5dee837 is going to be created. [ 594.926068] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.926068] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.926068] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.926068] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.926068] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.940125] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: afe348a4-4bdc-4830-8b52-3584e5dee837 in Status: IN_PROGRESS for 2s [ 594.943823] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5501386c-6d40-4911-b095-561660dd038b: rpc.has_security_group_logging(os_id): False [ 594.964019] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.964193] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.964241] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.964450] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.964531] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.965246] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.965246] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.965246] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.965246] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.965246] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.965568] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.965568] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.965568] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.965568] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.965755] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.965755] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.965840] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.966025] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.968953] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.968953] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.968953] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5501386c-6d40-4911-b095-561660dd038b is going to be created. [ 595.023890] env[65065]: INFO networking_nsxv3.common.synchronization [None req-f21b6460-0300-4bb2-81b8-31c50106ed0c None None] Enqueued Resource ID: cab2b7bf-e26e-4b2d-b17c-9656248c3b88 with Priority: HIGHEST for action port [ 595.024516] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cab2b7bf-e26e-4b2d-b17c-9656248c3b88 with Priority: HIGHEST for action port [ 595.024927] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-cab2b7bf-e26e-4b2d-b17c-9656248c3b88 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.025038] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cab2b7bf-e26e-4b2d-b17c-9656248c3b88" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.027600] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cab2b7bf-e26e-4b2d-b17c-9656248c3b88" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.027600] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cab2b7bf-e26e-4b2d-b17c-9656248c3b88" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.027600] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cab2b7bf-e26e-4b2d-b17c-9656248c3b88',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.064923] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.065085] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.066054] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.066054] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.066054] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.077637] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5501386c-6d40-4911-b095-561660dd038b in Status: IN_PROGRESS for 2s [ 595.225683] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f1104d25-6222-4924-b9c7-b33559b1415d [ 595.225979] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.226162] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.226255] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.226532] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.226642] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.226836] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f1104d25-6222-4924-b9c7-b33559b1415d already deleted. [ 595.226948] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f1104d25-6222-4924-b9c7-b33559b1415d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.529768] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cab2b7bf-e26e-4b2d-b17c-9656248c3b88 [ 595.530017] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.530153] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.530218] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.531374] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.531374] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.531374] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cab2b7bf-e26e-4b2d-b17c-9656248c3b88 already deleted. [ 595.531374] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cab2b7bf-e26e-4b2d-b17c-9656248c3b88" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.722270] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45d9fbda-3bbf-490e-af96-b968c92e95ba in Status: SUCCESS [ 596.722564] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45d9fbda-3bbf-490e-af96-b968c92e95ba" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.722650] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45d9fbda-3bbf-490e-af96-b968c92e95ba" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.722876] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45d9fbda-3bbf-490e-af96-b968c92e95ba" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.723141] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.723272] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.723333] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.723498] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.723597] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.723688] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45d9fbda-3bbf-490e-af96-b968c92e95ba" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.723783] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('45d9fbda-3bbf-490e-af96-b968c92e95ba',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.960468] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: afe348a4-4bdc-4830-8b52-3584e5dee837 in Status: SUCCESS [ 596.960828] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-afe348a4-4bdc-4830-8b52-3584e5dee837" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.092685] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5501386c-6d40-4911-b095-561660dd038b in Status: SUCCESS [ 597.092863] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5501386c-6d40-4911-b095-561660dd038b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.231056] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-45d9fbda-3bbf-490e-af96-b968c92e95ba taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.231056] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45d9fbda-3bbf-490e-af96-b968c92e95ba" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.231056] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45d9fbda-3bbf-490e-af96-b968c92e95ba" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.231056] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45d9fbda-3bbf-490e-af96-b968c92e95ba" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.231056] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.231056] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.231056] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.231056] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.231056] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.231056] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45d9fbda-3bbf-490e-af96-b968c92e95ba" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.231056] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-45d9fbda-3bbf-490e-af96-b968c92e95ba taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.231056] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45d9fbda-3bbf-490e-af96-b968c92e95ba" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.231056] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45d9fbda-3bbf-490e-af96-b968c92e95ba" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.231056] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45d9fbda-3bbf-490e-af96-b968c92e95ba" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.231056] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.231056] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.231945] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.231945] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.231945] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.231945] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45d9fbda-3bbf-490e-af96-b968c92e95ba" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.231945] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('45d9fbda-3bbf-490e-af96-b968c92e95ba',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.460345] env[65065]: INFO networking_nsxv3.common.synchronization [None req-0f3c715c-ae00-4b34-8a18-b68e6f554d87 None None] Enqueued Resource ID: 730c3899-8ee6-4067-8b5c-fb50fb5c379b with Priority: HIGHEST for action port [ 597.460917] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 730c3899-8ee6-4067-8b5c-fb50fb5c379b with Priority: HIGHEST for action port [ 597.461289] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-730c3899-8ee6-4067-8b5c-fb50fb5c379b taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.461397] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-730c3899-8ee6-4067-8b5c-fb50fb5c379b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.461801] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-730c3899-8ee6-4067-8b5c-fb50fb5c379b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.462184] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-730c3899-8ee6-4067-8b5c-fb50fb5c379b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.462353] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('730c3899-8ee6-4067-8b5c-fb50fb5c379b',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.735458] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 45d9fbda-3bbf-490e-af96-b968c92e95ba: rpc.has_security_group_logging(os_id): False [ 597.756350] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.756350] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.756350] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.756569] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.756604] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.757687] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.757687] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.757687] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.757687] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.757687] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.757687] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.757687] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.757687] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.758036] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.758036] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.761306] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.761450] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.761539] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.761788] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.761880] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.761976] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 45d9fbda-3bbf-490e-af96-b968c92e95ba is going to be created. [ 597.828057] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.828057] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.828057] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.828236] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.829901] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.845367] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 45d9fbda-3bbf-490e-af96-b968c92e95ba in Status: IN_PROGRESS for 2s [ 597.966319] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 730c3899-8ee6-4067-8b5c-fb50fb5c379b [ 597.966319] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.966319] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.966319] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.966319] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.966319] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.966319] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:730c3899-8ee6-4067-8b5c-fb50fb5c379b already deleted. [ 597.966319] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-730c3899-8ee6-4067-8b5c-fb50fb5c379b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.989607] env[65065]: INFO networking_nsxv3.common.synchronization [req-c11d023b-18d3-4070-8d87-3c1b8bb43e48 req-3fd23e96-2763-435b-bf78-ffa461ba70fb tempest-InstanceActionsTestJSON-20090509 tempest-InstanceActionsTestJSON-20090509-project-member] Enqueued Resource ID: 4a714159-17dd-4324-93b8-81c81e256b0e with Priority: HIGHEST for action security_group_members [ 597.990422] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a714159-17dd-4324-93b8-81c81e256b0e with Priority: HIGHEST for action security_group_members [ 597.990775] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a714159-17dd-4324-93b8-81c81e256b0e taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.993468] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a714159-17dd-4324-93b8-81c81e256b0e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.993468] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a714159-17dd-4324-93b8-81c81e256b0e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.993468] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a714159-17dd-4324-93b8-81c81e256b0e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.993468] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.993468] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.993468] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.993468] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.993468] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.993468] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4a714159-17dd-4324-93b8-81c81e256b0e',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.033493] env[65065]: INFO networking_nsxv3.common.synchronization [None req-bc22b1a1-0600-4a3f-8d36-47892809deaf None None] Enqueued Resource ID: 7bc1f331-095d-497b-841e-207dfec6696d with Priority: HIGHEST for action port [ 598.033493] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7bc1f331-095d-497b-841e-207dfec6696d with Priority: HIGHEST for action port [ 598.033493] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-7bc1f331-095d-497b-841e-207dfec6696d taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.035545] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7bc1f331-095d-497b-841e-207dfec6696d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.035545] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7bc1f331-095d-497b-841e-207dfec6696d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.035545] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7bc1f331-095d-497b-841e-207dfec6696d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.035545] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7bc1f331-095d-497b-841e-207dfec6696d',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.183383] env[65065]: INFO networking_nsxv3.common.synchronization [None req-b9ba42f9-2940-46cb-b82a-d16aa2194d36 tempest-ServersTestJSON-528503202 tempest-ServersTestJSON-528503202-project-member] Enqueued Resource ID: 16e2d0aa-9161-41ee-99b8-486218dfa51d with Priority: HIGHEST for action security_group_rules [ 598.185610] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16e2d0aa-9161-41ee-99b8-486218dfa51d with Priority: HIGHEST for action security_group_rules [ 598.186303] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-16e2d0aa-9161-41ee-99b8-486218dfa51d taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.186426] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-16e2d0aa-9161-41ee-99b8-486218dfa51d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.186493] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-16e2d0aa-9161-41ee-99b8-486218dfa51d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.186752] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-16e2d0aa-9161-41ee-99b8-486218dfa51d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.186848] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('16e2d0aa-9161-41ee-99b8-486218dfa51d',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.377487] env[65065]: INFO networking_nsxv3.common.synchronization [None req-a7d3d382-58a7-456a-9fad-a687e6213e4b tempest-ServersTestJSON-528503202 tempest-ServersTestJSON-528503202-project-member] Enqueued Resource ID: 16e2d0aa-9161-41ee-99b8-486218dfa51d with Priority: HIGHEST for action security_group_rules [ 598.377487] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16e2d0aa-9161-41ee-99b8-486218dfa51d with Priority: HIGHEST for action security_group_rules [ 598.378073] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-16e2d0aa-9161-41ee-99b8-486218dfa51d taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.378414] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-16e2d0aa-9161-41ee-99b8-486218dfa51d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.494453] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.494605] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.496592] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.496592] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.496592] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.496592] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.496933] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.496933] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.497049] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.499940] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.500121] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4a714159-17dd-4324-93b8-81c81e256b0e already deleted. [ 598.500228] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a714159-17dd-4324-93b8-81c81e256b0e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.537331] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7bc1f331-095d-497b-841e-207dfec6696d [ 598.539444] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.539767] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.539939] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.540261] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.540517] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.540791] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7bc1f331-095d-497b-841e-207dfec6696d already deleted. [ 598.540998] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7bc1f331-095d-497b-841e-207dfec6696d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.561546] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock network-441 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.562131] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "network-441" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.562601] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "network-441" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.568192] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "network-441" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.568192] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.568192] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.568192] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.568192] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.568192] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.568192] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 598.568192] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 598.568192] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 598.568192] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 598.568192] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 598.568192] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 598.568192] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 598.587698] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 598.588506] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 598.588506] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 598.588506] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "network-441" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.588687] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock port-84f65abf-2165-4ac3-ba9c-1d3b5824c346 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.588771] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "port-84f65abf-2165-4ac3-ba9c-1d3b5824c346" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.588859] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "port-84f65abf-2165-4ac3-ba9c-1d3b5824c346" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.589211] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "port-84f65abf-2165-4ac3-ba9c-1d3b5824c346" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.589323] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('84f65abf-2165-4ac3-ba9c-1d3b5824c346',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.711916] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.712108] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.712158] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.712343] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.712430] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.712517] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 16e2d0aa-9161-41ee-99b8-486218dfa51d already deleted. [ 598.712602] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-16e2d0aa-9161-41ee-99b8-486218dfa51d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.712831] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-16e2d0aa-9161-41ee-99b8-486218dfa51d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.713077] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-16e2d0aa-9161-41ee-99b8-486218dfa51d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.713166] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('16e2d0aa-9161-41ee-99b8-486218dfa51d',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.092479] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.093071] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.093071] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.093194] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.093385] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.093646] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Segment Port 84f65abf-2165-4ac3-ba9c-1d3b5824c346 not found, creating... [ 599.093985] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.094231] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.094408] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.094775] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.096154] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.096154] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.096154] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.096154] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.096702] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.096702] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.096868] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Resource: SegmentPort with ID: 84f65abf-2165-4ac3-ba9c-1d3b5824c346 is going to be created. [ 599.120230] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.120451] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.120579] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.120885] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.121735] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.122362] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "port-84f65abf-2165-4ac3-ba9c-1d3b5824c346" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.237805] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.238028] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.238130] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.239032] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.239032] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.239032] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 16e2d0aa-9161-41ee-99b8-486218dfa51d already deleted. [ 599.239032] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-16e2d0aa-9161-41ee-99b8-486218dfa51d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.839484] env[65065]: INFO networking_nsxv3.common.synchronization [req-c11d023b-18d3-4070-8d87-3c1b8bb43e48 req-4624af1a-0b1c-4ebc-928c-bfce80fbf4f1 service nova] Enqueued Resource ID: 4a714159-17dd-4324-93b8-81c81e256b0e with Priority: HIGHEST for action security_group_rules [ 599.839663] env[65065]: INFO networking_nsxv3.common.synchronization [req-c11d023b-18d3-4070-8d87-3c1b8bb43e48 req-4624af1a-0b1c-4ebc-928c-bfce80fbf4f1 service nova] Enqueued Resource ID: 4a714159-17dd-4324-93b8-81c81e256b0e with Priority: HIGHEST for action security_group_members [ 599.839792] env[65065]: INFO networking_nsxv3.common.synchronization [req-c11d023b-18d3-4070-8d87-3c1b8bb43e48 req-4624af1a-0b1c-4ebc-928c-bfce80fbf4f1 service nova] Enqueued Resource ID: 84f65abf-2165-4ac3-ba9c-1d3b5824c346 with Priority: HIGHEST for action port [ 599.840347] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a714159-17dd-4324-93b8-81c81e256b0e with Priority: HIGHEST for action security_group_rules [ 599.840483] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a714159-17dd-4324-93b8-81c81e256b0e with Priority: HIGHEST for action security_group_members [ 599.840617] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84f65abf-2165-4ac3-ba9c-1d3b5824c346 with Priority: HIGHEST for action port [ 599.840973] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4a714159-17dd-4324-93b8-81c81e256b0e taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.841235] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4a714159-17dd-4324-93b8-81c81e256b0e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.841319] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4a714159-17dd-4324-93b8-81c81e256b0e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.841637] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4a714159-17dd-4324-93b8-81c81e256b0e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.841746] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4a714159-17dd-4324-93b8-81c81e256b0e',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.843560] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a714159-17dd-4324-93b8-81c81e256b0e taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.843761] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a714159-17dd-4324-93b8-81c81e256b0e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.843906] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a714159-17dd-4324-93b8-81c81e256b0e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.844177] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a714159-17dd-4324-93b8-81c81e256b0e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.844417] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.844571] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.844610] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.844796] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.844915] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.845058] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4a714159-17dd-4324-93b8-81c81e256b0e',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.847539] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-84f65abf-2165-4ac3-ba9c-1d3b5824c346 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.847539] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-84f65abf-2165-4ac3-ba9c-1d3b5824c346" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.847711] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-84f65abf-2165-4ac3-ba9c-1d3b5824c346" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.848022] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-84f65abf-2165-4ac3-ba9c-1d3b5824c346" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.848118] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('84f65abf-2165-4ac3-ba9c-1d3b5824c346',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.866736] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 45d9fbda-3bbf-490e-af96-b968c92e95ba in Status: SUCCESS [ 599.866736] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-45d9fbda-3bbf-490e-af96-b968c92e95ba" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.316593] env[65065]: INFO networking_nsxv3.common.synchronization [req-7459427c-6758-404a-9673-713c6c999a38 req-211029fb-6a70-4842-9513-618f06c4c803 tempest-ServersTestFqdnHostnames-735698162 tempest-ServersTestFqdnHostnames-735698162-project-member] Enqueued Resource ID: 36775ca6-e5c8-4c23-bad8-a30192db7f3f with Priority: HIGHEST for action security_group_members [ 600.316593] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 36775ca6-e5c8-4c23-bad8-a30192db7f3f with Priority: HIGHEST for action security_group_members [ 600.317009] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-36775ca6-e5c8-4c23-bad8-a30192db7f3f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.317789] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-36775ca6-e5c8-4c23-bad8-a30192db7f3f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.317928] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-36775ca6-e5c8-4c23-bad8-a30192db7f3f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.318374] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-36775ca6-e5c8-4c23-bad8-a30192db7f3f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.319572] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.319572] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.319572] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.319819] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.319819] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.319819] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('36775ca6-e5c8-4c23-bad8-a30192db7f3f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.345917] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a714159-17dd-4324-93b8-81c81e256b0e taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.346207] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a714159-17dd-4324-93b8-81c81e256b0e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.347633] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4a714159-17dd-4324-93b8-81c81e256b0e',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.351884] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 84f65abf-2165-4ac3-ba9c-1d3b5824c346 with status ACTIVE [ 600.352150] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.352279] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.352396] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.352657] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.352814] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.352993] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.353155] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.353275] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.353411] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.353565] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.353741] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.353902] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.354074] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.354493] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.354584] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.354715] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 84f65abf-2165-4ac3-ba9c-1d3b5824c346 is going to be updated. [ 600.387489] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.387676] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.387742] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.388051] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.388203] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.388415] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-84f65abf-2165-4ac3-ba9c-1d3b5824c346" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.823035] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.823202] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.823278] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.823489] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.823578] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.823776] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.823868] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.823961] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.825130] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.825130] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.825130] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 36775ca6-e5c8-4c23-bad8-a30192db7f3f already deleted. [ 600.825130] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-36775ca6-e5c8-4c23-bad8-a30192db7f3f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.853310] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4a714159-17dd-4324-93b8-81c81e256b0e',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.007023] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock network-481 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.007023] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "network-481" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.007023] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "network-481" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.007023] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "network-481" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.007023] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.007023] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.011385] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.011385] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.011385] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.011385] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 601.011385] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 601.011385] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 601.011385] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 601.011385] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 601.011385] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 601.011385] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 601.031176] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 601.031350] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 601.031480] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 601.031649] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "network-481" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.032554] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock port-c84dc6b7-3cee-4607-b3b9-bec0db694588 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.032554] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "port-c84dc6b7-3cee-4607-b3b9-bec0db694588" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.032554] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "port-c84dc6b7-3cee-4607-b3b9-bec0db694588" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.032834] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "port-c84dc6b7-3cee-4607-b3b9-bec0db694588" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.032891] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c84dc6b7-3cee-4607-b3b9-bec0db694588',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.232225] env[65065]: INFO networking_nsxv3.common.synchronization [None req-14faa761-5af7-4f07-870e-c27aaf8d62e3 None None] Enqueued Resource ID: cd4242aa-1e34-493f-bd64-1f4554f74f2d with Priority: HIGHEST for action port [ 601.232756] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd4242aa-1e34-493f-bd64-1f4554f74f2d with Priority: HIGHEST for action port [ 601.233057] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-cd4242aa-1e34-493f-bd64-1f4554f74f2d taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.233196] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cd4242aa-1e34-493f-bd64-1f4554f74f2d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.233266] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cd4242aa-1e34-493f-bd64-1f4554f74f2d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.233480] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cd4242aa-1e34-493f-bd64-1f4554f74f2d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.233572] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cd4242aa-1e34-493f-bd64-1f4554f74f2d',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.356641] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.357064] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.357064] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.357137] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.357259] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.357330] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4a714159-17dd-4324-93b8-81c81e256b0e is going to be created. [ 601.383396] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.383861] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.383861] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.383861] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.384074] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.394386] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a714159-17dd-4324-93b8-81c81e256b0e in Status: UNINITIALIZED for 2s [ 601.396545] env[65065]: INFO networking_nsxv3.common.synchronization [None req-89f5823a-987d-4e54-96f5-21bb4126b48b None None] Enqueued Resource ID: 79c0e300-3e5d-47c9-b850-d94182160ab6 with Priority: HIGHEST for action port [ 601.397076] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79c0e300-3e5d-47c9-b850-d94182160ab6 with Priority: HIGHEST for action port [ 601.397374] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-79c0e300-3e5d-47c9-b850-d94182160ab6 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.397495] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-79c0e300-3e5d-47c9-b850-d94182160ab6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.397564] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-79c0e300-3e5d-47c9-b850-d94182160ab6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.397828] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-79c0e300-3e5d-47c9-b850-d94182160ab6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.397911] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('79c0e300-3e5d-47c9-b850-d94182160ab6',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.539022] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.539022] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.539022] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.539022] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.539022] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.539022] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Segment Port c84dc6b7-3cee-4607-b3b9-bec0db694588 not found, creating... [ 601.539022] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.539022] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.539022] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.539022] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.539022] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.539542] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.539542] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.539542] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.539542] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.539542] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.539542] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Resource: SegmentPort with ID: c84dc6b7-3cee-4607-b3b9-bec0db694588 is going to be created. [ 601.560761] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.561105] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.561198] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.561459] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.562066] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.562066] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "port-c84dc6b7-3cee-4607-b3b9-bec0db694588" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.739412] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cd4242aa-1e34-493f-bd64-1f4554f74f2d [ 601.739711] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.739932] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.740033] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.740288] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.740451] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.740579] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cd4242aa-1e34-493f-bd64-1f4554f74f2d already deleted. [ 601.740719] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cd4242aa-1e34-493f-bd64-1f4554f74f2d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.900618] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 79c0e300-3e5d-47c9-b850-d94182160ab6 [ 601.900727] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.901391] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.901391] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.901391] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.901391] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.901607] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:79c0e300-3e5d-47c9-b850-d94182160ab6 already deleted. [ 601.901607] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-79c0e300-3e5d-47c9-b850-d94182160ab6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.295694] env[65065]: INFO networking_nsxv3.common.synchronization [req-7459427c-6758-404a-9673-713c6c999a38 req-d88782dc-a6b1-4e59-855a-dc8ae072acd3 service nova] Enqueued Resource ID: 36775ca6-e5c8-4c23-bad8-a30192db7f3f with Priority: HIGHEST for action security_group_rules [ 602.295922] env[65065]: INFO networking_nsxv3.common.synchronization [req-7459427c-6758-404a-9673-713c6c999a38 req-d88782dc-a6b1-4e59-855a-dc8ae072acd3 service nova] Enqueued Resource ID: 36775ca6-e5c8-4c23-bad8-a30192db7f3f with Priority: HIGHEST for action security_group_members [ 602.296076] env[65065]: INFO networking_nsxv3.common.synchronization [req-7459427c-6758-404a-9673-713c6c999a38 req-d88782dc-a6b1-4e59-855a-dc8ae072acd3 service nova] Enqueued Resource ID: c84dc6b7-3cee-4607-b3b9-bec0db694588 with Priority: HIGHEST for action port [ 602.296639] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 36775ca6-e5c8-4c23-bad8-a30192db7f3f with Priority: HIGHEST for action security_group_rules [ 602.296911] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 36775ca6-e5c8-4c23-bad8-a30192db7f3f with Priority: HIGHEST for action security_group_members [ 602.297819] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c84dc6b7-3cee-4607-b3b9-bec0db694588 with Priority: HIGHEST for action port [ 602.298294] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-36775ca6-e5c8-4c23-bad8-a30192db7f3f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.298294] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-36775ca6-e5c8-4c23-bad8-a30192db7f3f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.298456] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-36775ca6-e5c8-4c23-bad8-a30192db7f3f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.298612] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-36775ca6-e5c8-4c23-bad8-a30192db7f3f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.298671] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('36775ca6-e5c8-4c23-bad8-a30192db7f3f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.299618] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-36775ca6-e5c8-4c23-bad8-a30192db7f3f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.299861] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-36775ca6-e5c8-4c23-bad8-a30192db7f3f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.299861] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-36775ca6-e5c8-4c23-bad8-a30192db7f3f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.300122] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-36775ca6-e5c8-4c23-bad8-a30192db7f3f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.300778] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.300778] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.300778] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.300778] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.300778] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.300778] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('36775ca6-e5c8-4c23-bad8-a30192db7f3f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.305943] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-c84dc6b7-3cee-4607-b3b9-bec0db694588 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.305943] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c84dc6b7-3cee-4607-b3b9-bec0db694588" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.305943] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c84dc6b7-3cee-4607-b3b9-bec0db694588" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.305943] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c84dc6b7-3cee-4607-b3b9-bec0db694588" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.306268] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c84dc6b7-3cee-4607-b3b9-bec0db694588',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.808584] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('36775ca6-e5c8-4c23-bad8-a30192db7f3f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.810493] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-36775ca6-e5c8-4c23-bad8-a30192db7f3f taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.810493] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-36775ca6-e5c8-4c23-bad8-a30192db7f3f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.810948] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c84dc6b7-3cee-4607-b3b9-bec0db694588 with status ACTIVE [ 602.811175] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.811559] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.811559] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.811703] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.811703] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.811903] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.812020] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.812131] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.812271] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.812365] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.812687] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.812687] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.812857] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.812909] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.812981] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.813095] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c84dc6b7-3cee-4607-b3b9-bec0db694588 is going to be updated. [ 602.844470] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.844470] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.844470] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.844470] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.844656] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.844742] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c84dc6b7-3cee-4607-b3b9-bec0db694588" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.107938] env[65065]: INFO networking_nsxv3.common.synchronization [req-81d89afd-d616-4222-b1aa-4cd4beaa6bbe req-7e6a03f1-20f1-4202-a57a-8f4ebdf70412 tempest-ServersAdminTestJSON-1746807080 tempest-ServersAdminTestJSON-1746807080-project-member] Enqueued Resource ID: ed4053b7-493c-48f8-b82e-b002cbcc3a61 with Priority: HIGHEST for action security_group_members [ 603.110265] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed4053b7-493c-48f8-b82e-b002cbcc3a61 with Priority: HIGHEST for action security_group_members [ 603.110707] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed4053b7-493c-48f8-b82e-b002cbcc3a61 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.110930] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.111033] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.111977] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.112250] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.112394] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.112495] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.112644] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.112729] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.112849] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ed4053b7-493c-48f8-b82e-b002cbcc3a61',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.311812] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('36775ca6-e5c8-4c23-bad8-a30192db7f3f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.405991] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a714159-17dd-4324-93b8-81c81e256b0e in Status: SUCCESS [ 603.406233] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a714159-17dd-4324-93b8-81c81e256b0e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.406386] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a714159-17dd-4324-93b8-81c81e256b0e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.406648] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a714159-17dd-4324-93b8-81c81e256b0e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.406773] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.406949] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.407025] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.407181] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.407270] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.407344] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a714159-17dd-4324-93b8-81c81e256b0e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.407435] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4a714159-17dd-4324-93b8-81c81e256b0e',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.490512] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock network-829 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.490709] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "network-829" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.490833] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "network-829" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.491192] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "network-829" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.491927] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.491927] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.491927] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.491927] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.493372] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.493827] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 603.494063] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 603.494350] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 603.494350] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 603.494543] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 603.494543] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 603.494826] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 603.515177] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 603.517626] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 603.517626] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 603.517626] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "network-829" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.517626] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock port-e0240b41-f726-499d-9e4c-61391777c097 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.517626] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "port-e0240b41-f726-499d-9e4c-61391777c097" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.517626] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "port-e0240b41-f726-499d-9e4c-61391777c097" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.517626] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "port-e0240b41-f726-499d-9e4c-61391777c097" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.517626] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e0240b41-f726-499d-9e4c-61391777c097',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.617402] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.617556] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.617627] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.617835] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.617967] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.618303] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.618431] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.618632] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.618837] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.619885] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.620011] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ed4053b7-493c-48f8-b82e-b002cbcc3a61 already deleted. [ 603.620120] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.814486] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.814830] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.814830] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.814950] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.815048] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.815147] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 36775ca6-e5c8-4c23-bad8-a30192db7f3f is going to be created. [ 603.848845] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.849051] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.849160] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.849330] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.850025] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.859926] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 36775ca6-e5c8-4c23-bad8-a30192db7f3f in Status: UNINITIALIZED for 2s [ 603.910741] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a714159-17dd-4324-93b8-81c81e256b0e taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.910741] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a714159-17dd-4324-93b8-81c81e256b0e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.910741] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a714159-17dd-4324-93b8-81c81e256b0e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.910741] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a714159-17dd-4324-93b8-81c81e256b0e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.910741] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.910741] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.910741] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.911349] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.911504] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.911730] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a714159-17dd-4324-93b8-81c81e256b0e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.911944] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a714159-17dd-4324-93b8-81c81e256b0e taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.912107] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a714159-17dd-4324-93b8-81c81e256b0e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.912215] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a714159-17dd-4324-93b8-81c81e256b0e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.912410] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a714159-17dd-4324-93b8-81c81e256b0e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.912646] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.912790] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.912889] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.913098] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.913232] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.913357] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a714159-17dd-4324-93b8-81c81e256b0e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.913483] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4a714159-17dd-4324-93b8-81c81e256b0e',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.019511] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.019656] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.019779] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.020416] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.020416] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.020416] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Segment Port e0240b41-f726-499d-9e4c-61391777c097 not found, creating... [ 604.020626] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.020724] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.020840] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.021062] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.021198] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.021878] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.021878] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.021878] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.022431] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.022431] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.022431] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Resource: SegmentPort with ID: e0240b41-f726-499d-9e4c-61391777c097 is going to be created. [ 604.046189] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.046509] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.046954] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.047265] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.047500] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.047828] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "port-e0240b41-f726-499d-9e4c-61391777c097" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.054322] env[65065]: INFO networking_nsxv3.common.synchronization [None req-a6a35ab3-c2f2-41d0-8619-80dc97920f48 None None] Enqueued Resource ID: 35d7cb94-cbdf-43c4-ad7d-df69b6990320 with Priority: HIGHEST for action port [ 604.055527] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35d7cb94-cbdf-43c4-ad7d-df69b6990320 with Priority: HIGHEST for action port [ 604.056176] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-35d7cb94-cbdf-43c4-ad7d-df69b6990320 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.056176] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-35d7cb94-cbdf-43c4-ad7d-df69b6990320" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.056176] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-35d7cb94-cbdf-43c4-ad7d-df69b6990320" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.056481] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-35d7cb94-cbdf-43c4-ad7d-df69b6990320" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.056590] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('35d7cb94-cbdf-43c4-ad7d-df69b6990320',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.415631] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4a714159-17dd-4324-93b8-81c81e256b0e: rpc.has_security_group_logging(os_id): False [ 604.437705] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.437909] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.438138] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.438177] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.438370] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.438484] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.438548] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.438592] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.438743] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.438818] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.439012] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.439139] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.439215] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.439358] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.439432] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.439605] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.439725] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.439765] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.439888] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.439962] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.440067] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4a714159-17dd-4324-93b8-81c81e256b0e is going to be created. [ 604.503450] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.503450] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.503450] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.503610] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.504131] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.516771] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4a714159-17dd-4324-93b8-81c81e256b0e in Status: IN_PROGRESS for 2s [ 604.559268] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 35d7cb94-cbdf-43c4-ad7d-df69b6990320 [ 604.560423] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.560590] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.560911] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.561494] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.561494] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.561494] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:35d7cb94-cbdf-43c4-ad7d-df69b6990320 already deleted. [ 604.561494] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-35d7cb94-cbdf-43c4-ad7d-df69b6990320" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.816221] env[65065]: INFO networking_nsxv3.common.synchronization [req-81d89afd-d616-4222-b1aa-4cd4beaa6bbe req-2eaf88a8-4e54-4b26-a95e-ba03bcd9df6f service nova] Enqueued Resource ID: ed4053b7-493c-48f8-b82e-b002cbcc3a61 with Priority: HIGHEST for action security_group_rules [ 604.816462] env[65065]: INFO networking_nsxv3.common.synchronization [req-81d89afd-d616-4222-b1aa-4cd4beaa6bbe req-2eaf88a8-4e54-4b26-a95e-ba03bcd9df6f service nova] Enqueued Resource ID: ed4053b7-493c-48f8-b82e-b002cbcc3a61 with Priority: HIGHEST for action security_group_members [ 604.817025] env[65065]: INFO networking_nsxv3.common.synchronization [req-81d89afd-d616-4222-b1aa-4cd4beaa6bbe req-2eaf88a8-4e54-4b26-a95e-ba03bcd9df6f service nova] Enqueued Resource ID: e0240b41-f726-499d-9e4c-61391777c097 with Priority: HIGHEST for action port [ 604.817276] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed4053b7-493c-48f8-b82e-b002cbcc3a61 with Priority: HIGHEST for action security_group_rules [ 604.817276] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed4053b7-493c-48f8-b82e-b002cbcc3a61 with Priority: HIGHEST for action security_group_members [ 604.817394] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0240b41-f726-499d-9e4c-61391777c097 with Priority: HIGHEST for action port [ 604.817610] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ed4053b7-493c-48f8-b82e-b002cbcc3a61 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.817723] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.817785] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.818046] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.818117] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ed4053b7-493c-48f8-b82e-b002cbcc3a61',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.818966] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed4053b7-493c-48f8-b82e-b002cbcc3a61 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.819093] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.820476] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.820476] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.820476] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.820476] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.820476] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.820476] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.820476] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.820476] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ed4053b7-493c-48f8-b82e-b002cbcc3a61',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.820816] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-e0240b41-f726-499d-9e4c-61391777c097 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.820816] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e0240b41-f726-499d-9e4c-61391777c097" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.820816] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e0240b41-f726-499d-9e4c-61391777c097" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.820926] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e0240b41-f726-499d-9e4c-61391777c097" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.820997] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e0240b41-f726-499d-9e4c-61391777c097',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.858885] env[65065]: INFO networking_nsxv3.common.synchronization [req-49b45a4d-504b-4298-b7a8-040d9ed17375 req-2f7a225f-7d26-4b37-a4ec-29c2940f494b tempest-VolumesAdminNegativeTest-733073170 tempest-VolumesAdminNegativeTest-733073170-project-member] Enqueued Resource ID: 8a13ba64-a593-4798-b668-78791377ba50 with Priority: HIGHEST for action security_group_members [ 604.864143] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a13ba64-a593-4798-b668-78791377ba50 with Priority: HIGHEST for action security_group_members [ 604.864143] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a13ba64-a593-4798-b668-78791377ba50 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.864143] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a13ba64-a593-4798-b668-78791377ba50" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.864143] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a13ba64-a593-4798-b668-78791377ba50" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.864143] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a13ba64-a593-4798-b668-78791377ba50" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.864143] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.864143] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.864143] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.864143] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.864143] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.864143] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8a13ba64-a593-4798-b668-78791377ba50',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.299106] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock network-418 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.299347] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "network-418" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.299469] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "network-418" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.299788] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "network-418" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.300101] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.300685] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.300685] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.300685] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.300820] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.300962] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 605.301089] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 605.301197] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 605.301302] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 605.301419] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 605.301520] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 605.301653] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 605.324028] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed4053b7-493c-48f8-b82e-b002cbcc3a61 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.324465] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.324465] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ed4053b7-493c-48f8-b82e-b002cbcc3a61',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.326196] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 605.326365] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 605.326476] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 605.326984] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "network-418" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.327665] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock port-c0ccd1c9-052d-4434-8aae-9f9c9ae9c3c5 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.328104] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "port-c0ccd1c9-052d-4434-8aae-9f9c9ae9c3c5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.328176] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "port-c0ccd1c9-052d-4434-8aae-9f9c9ae9c3c5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.329246] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "port-c0ccd1c9-052d-4434-8aae-9f9c9ae9c3c5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.329246] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c0ccd1c9-052d-4434-8aae-9f9c9ae9c3c5',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.329746] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e0240b41-f726-499d-9e4c-61391777c097 with status ACTIVE [ 605.330040] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.330182] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.330268] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.330472] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.331124] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.331124] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.331124] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.331578] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.331833] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.331965] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.332245] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.332531] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.332531] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.332618] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.332699] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.332814] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e0240b41-f726-499d-9e4c-61391777c097 is going to be updated. [ 605.359602] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.359748] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.359792] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.361061] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.361061] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.361061] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e0240b41-f726-499d-9e4c-61391777c097" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.366958] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.367119] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.367188] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.367434] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.367569] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.367785] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.367998] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.368123] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.368343] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.368432] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.368508] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a13ba64-a593-4798-b668-78791377ba50 already deleted. [ 605.368585] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a13ba64-a593-4798-b668-78791377ba50" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.836590] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ed4053b7-493c-48f8-b82e-b002cbcc3a61',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.838204] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.838450] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.838609] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.839103] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.839184] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.839332] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Segment Port c0ccd1c9-052d-4434-8aae-9f9c9ae9c3c5 not found, creating... [ 605.839659] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.839858] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.840017] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.840292] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.840466] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.840824] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.841033] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.841341] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.841447] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.841614] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.841789] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Resource: SegmentPort with ID: c0ccd1c9-052d-4434-8aae-9f9c9ae9c3c5 is going to be created. [ 605.864083] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.864379] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.864504] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.864837] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.865143] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.865419] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "port-c0ccd1c9-052d-4434-8aae-9f9c9ae9c3c5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.877953] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 36775ca6-e5c8-4c23-bad8-a30192db7f3f in Status: SUCCESS [ 605.878081] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-36775ca6-e5c8-4c23-bad8-a30192db7f3f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.878223] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-36775ca6-e5c8-4c23-bad8-a30192db7f3f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.878511] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-36775ca6-e5c8-4c23-bad8-a30192db7f3f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.878631] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.878751] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.878814] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.878962] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.879066] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.879328] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-36775ca6-e5c8-4c23-bad8-a30192db7f3f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.879429] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('36775ca6-e5c8-4c23-bad8-a30192db7f3f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.344103] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.344282] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.344373] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.344624] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.344768] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.344850] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ed4053b7-493c-48f8-b82e-b002cbcc3a61 is going to be created. [ 606.375017] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.375141] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.375196] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.375479] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.375644] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.382655] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('36775ca6-e5c8-4c23-bad8-a30192db7f3f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.390709] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed4053b7-493c-48f8-b82e-b002cbcc3a61 in Status: UNINITIALIZED for 2s [ 606.532034] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4a714159-17dd-4324-93b8-81c81e256b0e in Status: SUCCESS [ 606.532250] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4a714159-17dd-4324-93b8-81c81e256b0e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.580901] env[65065]: INFO networking_nsxv3.common.synchronization [req-49b45a4d-504b-4298-b7a8-040d9ed17375 req-587d679c-d79d-486a-aa5a-6e3493dbadd8 service nova] Enqueued Resource ID: 8a13ba64-a593-4798-b668-78791377ba50 with Priority: HIGHEST for action security_group_rules [ 606.581531] env[65065]: INFO networking_nsxv3.common.synchronization [req-49b45a4d-504b-4298-b7a8-040d9ed17375 req-587d679c-d79d-486a-aa5a-6e3493dbadd8 service nova] Enqueued Resource ID: 8a13ba64-a593-4798-b668-78791377ba50 with Priority: HIGHEST for action security_group_members [ 606.581573] env[65065]: INFO networking_nsxv3.common.synchronization [req-49b45a4d-504b-4298-b7a8-040d9ed17375 req-587d679c-d79d-486a-aa5a-6e3493dbadd8 service nova] Enqueued Resource ID: c0ccd1c9-052d-4434-8aae-9f9c9ae9c3c5 with Priority: HIGHEST for action port [ 606.582185] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a13ba64-a593-4798-b668-78791377ba50 with Priority: HIGHEST for action security_group_rules [ 606.582428] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a13ba64-a593-4798-b668-78791377ba50 with Priority: HIGHEST for action security_group_members [ 606.582573] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0ccd1c9-052d-4434-8aae-9f9c9ae9c3c5 with Priority: HIGHEST for action port [ 606.582934] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8a13ba64-a593-4798-b668-78791377ba50 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.583235] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8a13ba64-a593-4798-b668-78791377ba50" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.583281] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8a13ba64-a593-4798-b668-78791377ba50" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.583539] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8a13ba64-a593-4798-b668-78791377ba50" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.583655] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8a13ba64-a593-4798-b668-78791377ba50',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.584790] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a13ba64-a593-4798-b668-78791377ba50 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.584991] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a13ba64-a593-4798-b668-78791377ba50" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.585435] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a13ba64-a593-4798-b668-78791377ba50" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.585435] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a13ba64-a593-4798-b668-78791377ba50" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.585635] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.585769] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.585859] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.586113] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.586236] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.586406] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8a13ba64-a593-4798-b668-78791377ba50',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.588415] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-c0ccd1c9-052d-4434-8aae-9f9c9ae9c3c5 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.588415] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c0ccd1c9-052d-4434-8aae-9f9c9ae9c3c5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.588415] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c0ccd1c9-052d-4434-8aae-9f9c9ae9c3c5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.588415] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c0ccd1c9-052d-4434-8aae-9f9c9ae9c3c5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.588415] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c0ccd1c9-052d-4434-8aae-9f9c9ae9c3c5',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.640205] env[65065]: INFO networking_nsxv3.common.synchronization [None req-f8e51122-448a-4776-b05d-8dfb5a7e60de None None] Enqueued Resource ID: 4e73536c-1c7f-4914-bc11-221d5dee85ef with Priority: HIGHEST for action port [ 606.640205] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e73536c-1c7f-4914-bc11-221d5dee85ef with Priority: HIGHEST for action port [ 606.640205] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-4e73536c-1c7f-4914-bc11-221d5dee85ef taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.640205] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4e73536c-1c7f-4914-bc11-221d5dee85ef" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.640205] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4e73536c-1c7f-4914-bc11-221d5dee85ef" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.640406] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4e73536c-1c7f-4914-bc11-221d5dee85ef" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.640406] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4e73536c-1c7f-4914-bc11-221d5dee85ef',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.886640] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 36775ca6-e5c8-4c23-bad8-a30192db7f3f: rpc.has_security_group_logging(os_id): False [ 606.907143] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.907143] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.909414] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.909414] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.909414] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.909414] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.909414] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.909414] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.909414] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.909414] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.909414] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 36775ca6-e5c8-4c23-bad8-a30192db7f3f is going to be created. [ 607.003638] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.003865] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.004012] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.004319] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.004610] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.015925] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 36775ca6-e5c8-4c23-bad8-a30192db7f3f in Status: IN_PROGRESS for 2s [ 607.090466] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a13ba64-a593-4798-b668-78791377ba50 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.090758] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a13ba64-a593-4798-b668-78791377ba50" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.092764] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8a13ba64-a593-4798-b668-78791377ba50',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.094999] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c0ccd1c9-052d-4434-8aae-9f9c9ae9c3c5 with status ACTIVE [ 607.096967] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.097440] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.097593] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.098264] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.098264] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.098432] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.098623] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.098704] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.099021] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.099120] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.099369] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.099531] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.099627] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.099877] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.100035] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.100190] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c0ccd1c9-052d-4434-8aae-9f9c9ae9c3c5 is going to be updated. [ 607.140643] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.140808] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.140880] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.141176] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.141522] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.141522] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c0ccd1c9-052d-4434-8aae-9f9c9ae9c3c5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.142876] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4e73536c-1c7f-4914-bc11-221d5dee85ef [ 607.143076] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.143194] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.143275] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.143465] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.143548] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.143659] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4e73536c-1c7f-4914-bc11-221d5dee85ef already deleted. [ 607.143740] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4e73536c-1c7f-4914-bc11-221d5dee85ef" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.326527] env[65065]: INFO networking_nsxv3.common.synchronization [req-1c1f1ef3-82ed-4740-b093-0034de8cbabf req-2d83ef98-a551-45cc-8fdf-c8e4fbf29fda tempest-AttachInterfacesV270Test-1576634480 tempest-AttachInterfacesV270Test-1576634480-project-member] Enqueued Resource ID: 36b0a7bf-c185-47f8-9c6c-88ed66cc1f56 with Priority: HIGHEST for action security_group_members [ 607.326527] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 36b0a7bf-c185-47f8-9c6c-88ed66cc1f56 with Priority: HIGHEST for action security_group_members [ 607.326655] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-36b0a7bf-c185-47f8-9c6c-88ed66cc1f56 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.326725] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-36b0a7bf-c185-47f8-9c6c-88ed66cc1f56" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.329091] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-36b0a7bf-c185-47f8-9c6c-88ed66cc1f56" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.330449] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-36b0a7bf-c185-47f8-9c6c-88ed66cc1f56" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.330662] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.330792] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.330840] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.331089] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.331160] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.331209] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('36b0a7bf-c185-47f8-9c6c-88ed66cc1f56',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.606369] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8a13ba64-a593-4798-b668-78791377ba50',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.700953] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock network-506 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.701178] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "network-506" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.701295] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "network-506" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.701653] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "network-506" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.701959] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.705815] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.705815] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.706464] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.706464] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.706663] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 607.706781] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 607.706955] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 607.707106] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 607.707258] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 607.707430] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 607.707635] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 607.729698] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 607.729839] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 607.730102] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 607.730182] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "network-506" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.730478] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock port-acc46f40-a4f4-439a-a06c-02230ececf56 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.730656] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "port-acc46f40-a4f4-439a-a06c-02230ececf56" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.730890] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "port-acc46f40-a4f4-439a-a06c-02230ececf56" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.731169] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "port-acc46f40-a4f4-439a-a06c-02230ececf56" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.731318] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('acc46f40-a4f4-439a-a06c-02230ececf56',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.835313] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.835560] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.835732] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.835873] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.835988] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.836333] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.836484] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.836642] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.836723] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.837066] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.837066] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 36b0a7bf-c185-47f8-9c6c-88ed66cc1f56 already deleted. [ 607.837066] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-36b0a7bf-c185-47f8-9c6c-88ed66cc1f56" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.109876] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.110272] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.110272] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.110594] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.114023] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.114023] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a13ba64-a593-4798-b668-78791377ba50 is going to be created. [ 608.142036] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.142036] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.142036] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.142241] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.142444] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.155339] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a13ba64-a593-4798-b668-78791377ba50 in Status: UNINITIALIZED for 2s [ 608.235284] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.236183] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.237658] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.237658] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.237658] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.237658] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Segment Port acc46f40-a4f4-439a-a06c-02230ececf56 not found, creating... [ 608.238292] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.239028] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.239811] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.240090] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.240090] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.241026] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.241026] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.241026] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.241026] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.241026] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.241297] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Resource: SegmentPort with ID: acc46f40-a4f4-439a-a06c-02230ececf56 is going to be created. [ 608.266038] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.266271] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.266359] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.266614] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.266838] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.267131] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "port-acc46f40-a4f4-439a-a06c-02230ececf56" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.402472] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed4053b7-493c-48f8-b82e-b002cbcc3a61 in Status: SUCCESS [ 608.402695] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.402847] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.402984] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.403389] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.403389] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.403389] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.403598] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.403598] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.403697] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.403801] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ed4053b7-493c-48f8-b82e-b002cbcc3a61',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.907058] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed4053b7-493c-48f8-b82e-b002cbcc3a61 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.907502] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.907786] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.908168] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.908710] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.908710] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.908710] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.908943] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.909146] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.909638] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.914177] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed4053b7-493c-48f8-b82e-b002cbcc3a61 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.914177] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.914177] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.914177] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.914177] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.914177] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.914177] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.914177] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.915612] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.915612] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.915612] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ed4053b7-493c-48f8-b82e-b002cbcc3a61',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.971681] env[65065]: INFO networking_nsxv3.common.synchronization [req-1c1f1ef3-82ed-4740-b093-0034de8cbabf req-c1e31fac-f5f8-4bfa-af2a-59aaede54fbf service nova] Enqueued Resource ID: 36b0a7bf-c185-47f8-9c6c-88ed66cc1f56 with Priority: HIGHEST for action security_group_rules [ 608.971681] env[65065]: INFO networking_nsxv3.common.synchronization [req-1c1f1ef3-82ed-4740-b093-0034de8cbabf req-c1e31fac-f5f8-4bfa-af2a-59aaede54fbf service nova] Enqueued Resource ID: 36b0a7bf-c185-47f8-9c6c-88ed66cc1f56 with Priority: HIGHEST for action security_group_members [ 608.971681] env[65065]: INFO networking_nsxv3.common.synchronization [req-1c1f1ef3-82ed-4740-b093-0034de8cbabf req-c1e31fac-f5f8-4bfa-af2a-59aaede54fbf service nova] Enqueued Resource ID: acc46f40-a4f4-439a-a06c-02230ececf56 with Priority: HIGHEST for action port [ 608.971681] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 36b0a7bf-c185-47f8-9c6c-88ed66cc1f56 with Priority: HIGHEST for action security_group_rules [ 608.971681] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 36b0a7bf-c185-47f8-9c6c-88ed66cc1f56 with Priority: HIGHEST for action security_group_members [ 608.971681] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: acc46f40-a4f4-439a-a06c-02230ececf56 with Priority: HIGHEST for action port [ 608.973015] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-36b0a7bf-c185-47f8-9c6c-88ed66cc1f56 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.973319] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-36b0a7bf-c185-47f8-9c6c-88ed66cc1f56" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.973499] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-36b0a7bf-c185-47f8-9c6c-88ed66cc1f56" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.974459] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-36b0a7bf-c185-47f8-9c6c-88ed66cc1f56" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.977189] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('36b0a7bf-c185-47f8-9c6c-88ed66cc1f56',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.977189] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-36b0a7bf-c185-47f8-9c6c-88ed66cc1f56 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.977189] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-36b0a7bf-c185-47f8-9c6c-88ed66cc1f56" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.977189] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-36b0a7bf-c185-47f8-9c6c-88ed66cc1f56" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.977189] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-36b0a7bf-c185-47f8-9c6c-88ed66cc1f56" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.977189] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.977189] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.977189] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.977189] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.977189] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.977189] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('36b0a7bf-c185-47f8-9c6c-88ed66cc1f56',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.978871] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-acc46f40-a4f4-439a-a06c-02230ececf56 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.979212] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-acc46f40-a4f4-439a-a06c-02230ececf56" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.979435] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-acc46f40-a4f4-439a-a06c-02230ececf56" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.979736] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-acc46f40-a4f4-439a-a06c-02230ececf56" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.979955] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('acc46f40-a4f4-439a-a06c-02230ececf56',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.031803] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 36775ca6-e5c8-4c23-bad8-a30192db7f3f in Status: SUCCESS [ 609.032097] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-36775ca6-e5c8-4c23-bad8-a30192db7f3f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.150306] env[65065]: INFO networking_nsxv3.common.synchronization [req-0348970b-f25a-42f9-9722-9c46675f674c req-ad835bb7-434c-41db-a385-2afc31c25fe1 tempest-ServersAdminTestJSON-1746807080 tempest-ServersAdminTestJSON-1746807080-project-member] Enqueued Resource ID: ed4053b7-493c-48f8-b82e-b002cbcc3a61 with Priority: HIGHEST for action security_group_members [ 609.151102] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed4053b7-493c-48f8-b82e-b002cbcc3a61 with Priority: HIGHEST for action security_group_members [ 609.151509] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed4053b7-493c-48f8-b82e-b002cbcc3a61 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.151901] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.151901] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.152238] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.152238] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.152533] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.152533] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.152762] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.152861] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.153896] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ed4053b7-493c-48f8-b82e-b002cbcc3a61',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.303260] env[65065]: INFO networking_nsxv3.common.synchronization [None req-c936a6e7-a071-409c-aee9-bae33e16f79e None None] Enqueued Resource ID: 21bb712d-2f0d-436f-9f61-6af5ca4a5f87 with Priority: HIGHEST for action port [ 609.304291] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21bb712d-2f0d-436f-9f61-6af5ca4a5f87 with Priority: HIGHEST for action port [ 609.304896] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-21bb712d-2f0d-436f-9f61-6af5ca4a5f87 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.304896] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-21bb712d-2f0d-436f-9f61-6af5ca4a5f87" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.304896] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-21bb712d-2f0d-436f-9f61-6af5ca4a5f87" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.305277] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-21bb712d-2f0d-436f-9f61-6af5ca4a5f87" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.306200] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('21bb712d-2f0d-436f-9f61-6af5ca4a5f87',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.417070] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ed4053b7-493c-48f8-b82e-b002cbcc3a61: rpc.has_security_group_logging(os_id): False [ 609.437884] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.438014] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.438105] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.438356] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.438477] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.438727] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.438860] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.438953] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.439367] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.439475] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.439708] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.440152] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.440152] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.440216] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.440277] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.440557] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.440557] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.440638] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.440746] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.440820] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.440905] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ed4053b7-493c-48f8-b82e-b002cbcc3a61 is going to be created. [ 609.483333] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-36b0a7bf-c185-47f8-9c6c-88ed66cc1f56 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.483333] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-36b0a7bf-c185-47f8-9c6c-88ed66cc1f56" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.483333] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('36b0a7bf-c185-47f8-9c6c-88ed66cc1f56',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.483333] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port acc46f40-a4f4-439a-a06c-02230ececf56 with status ACTIVE [ 609.487014] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.487014] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.487014] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.487014] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.487014] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.487014] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.487014] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.487014] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.487014] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.487014] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.494078] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.494078] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.494078] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.494078] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.494078] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.494078] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: acc46f40-a4f4-439a-a06c-02230ececf56 is going to be updated. [ 609.509813] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.512023] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.512023] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.512023] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.512023] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.520379] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.520379] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.520379] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.520379] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.520379] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.520379] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-acc46f40-a4f4-439a-a06c-02230ececf56" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.528245] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ed4053b7-493c-48f8-b82e-b002cbcc3a61 in Status: IN_PROGRESS for 2s [ 609.578335] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock network-829 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.578335] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "network-829" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.578335] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "network-829" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.578335] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "network-829" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.578335] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.578335] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.578335] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.578335] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.578335] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.578335] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 609.578335] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 609.578335] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 609.578335] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 609.579016] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 609.579016] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 609.579016] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 609.620581] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 609.620747] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Cache value generated in 0.042 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 609.620959] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 609.621271] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "network-829" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.621509] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock port-8501a5a0-b950-43f9-a264-0eef03029573 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.621847] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "port-8501a5a0-b950-43f9-a264-0eef03029573" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.622188] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "port-8501a5a0-b950-43f9-a264-0eef03029573" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.622865] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "port-8501a5a0-b950-43f9-a264-0eef03029573" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.623149] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8501a5a0-b950-43f9-a264-0eef03029573',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.657491] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ed4053b7-493c-48f8-b82e-b002cbcc3a61',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.808392] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 21bb712d-2f0d-436f-9f61-6af5ca4a5f87 [ 609.808647] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.808788] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.808864] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.809203] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.809314] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.809396] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:21bb712d-2f0d-436f-9f61-6af5ca4a5f87 already deleted. [ 609.809466] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-21bb712d-2f0d-436f-9f61-6af5ca4a5f87" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.932073] env[65065]: INFO networking_nsxv3.common.synchronization [req-46ebfbe0-2666-4a2f-abca-f47f17b56a51 req-e1fc21c4-2c50-42ce-99e9-83dadd18137e tempest-DeleteServersAdminTestJSON-1069328237 tempest-DeleteServersAdminTestJSON-1069328237-project-admin] Enqueued Resource ID: 5501386c-6d40-4911-b095-561660dd038b with Priority: HIGHEST for action security_group_members [ 609.932423] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5501386c-6d40-4911-b095-561660dd038b with Priority: HIGHEST for action security_group_members [ 609.932730] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-5501386c-6d40-4911-b095-561660dd038b taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.932863] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5501386c-6d40-4911-b095-561660dd038b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.932931] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5501386c-6d40-4911-b095-561660dd038b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.933276] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5501386c-6d40-4911-b095-561660dd038b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.933415] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.933523] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.933585] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.933744] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.933829] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.933924] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5501386c-6d40-4911-b095-561660dd038b',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.993758] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('36b0a7bf-c185-47f8-9c6c-88ed66cc1f56',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.133732] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.134146] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.134146] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.134290] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.134420] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.134604] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Segment Port 8501a5a0-b950-43f9-a264-0eef03029573 not found, creating... [ 610.134832] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.135026] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.135152] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.135439] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.135491] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.135755] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.135908] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.136028] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.136224] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.136347] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.136471] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Resource: SegmentPort with ID: 8501a5a0-b950-43f9-a264-0eef03029573 is going to be created. [ 610.160165] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.160830] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.160830] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.160830] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.161552] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.161552] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "port-8501a5a0-b950-43f9-a264-0eef03029573" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.162534] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ed4053b7-493c-48f8-b82e-b002cbcc3a61',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.167656] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a13ba64-a593-4798-b668-78791377ba50 in Status: SUCCESS [ 610.167656] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a13ba64-a593-4798-b668-78791377ba50" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.167656] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a13ba64-a593-4798-b668-78791377ba50" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.167928] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a13ba64-a593-4798-b668-78791377ba50" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.168019] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.168126] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.168194] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.168356] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.168437] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.169054] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a13ba64-a593-4798-b668-78791377ba50" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.169704] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8a13ba64-a593-4798-b668-78791377ba50',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.436030] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.436205] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.436275] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.436499] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.436590] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.436836] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.437125] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.437268] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.437525] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.437666] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.437817] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5501386c-6d40-4911-b095-561660dd038b is going to be updated. [ 610.475302] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.475479] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.475574] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.476193] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.476271] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.486259] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5501386c-6d40-4911-b095-561660dd038b in Status: IN_PROGRESS for 2s [ 610.496520] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.496657] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.496716] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.496966] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.497114] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.497362] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 36b0a7bf-c185-47f8-9c6c-88ed66cc1f56 is going to be created. [ 610.536429] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.536623] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.537084] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.537084] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.537249] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.547277] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 36b0a7bf-c185-47f8-9c6c-88ed66cc1f56 in Status: UNINITIALIZED for 2s [ 610.660370] env[65065]: INFO networking_nsxv3.common.synchronization [None req-c4c13aba-ac07-4747-95fb-5e7d3c54dba8 tempest-ServersWithSpecificFlavorTestJSON-1007896152 tempest-ServersWithSpecificFlavorTestJSON-1007896152-project-member] Enqueued Resource ID: 9576b45f-b344-47bd-8f8b-9df4c3725ddb with Priority: HIGHEST for action security_group_rules [ 610.661382] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9576b45f-b344-47bd-8f8b-9df4c3725ddb with Priority: HIGHEST for action security_group_rules [ 610.661700] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9576b45f-b344-47bd-8f8b-9df4c3725ddb taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.661829] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9576b45f-b344-47bd-8f8b-9df4c3725ddb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.661897] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9576b45f-b344-47bd-8f8b-9df4c3725ddb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.662175] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9576b45f-b344-47bd-8f8b-9df4c3725ddb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.662266] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9576b45f-b344-47bd-8f8b-9df4c3725ddb',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.669202] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.669419] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.670123] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.670402] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.671283] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.671283] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ed4053b7-493c-48f8-b82e-b002cbcc3a61 is going to be updated. [ 610.672529] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a13ba64-a593-4798-b668-78791377ba50 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.672635] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a13ba64-a593-4798-b668-78791377ba50" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.672673] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a13ba64-a593-4798-b668-78791377ba50" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.672853] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a13ba64-a593-4798-b668-78791377ba50" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.673013] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.673114] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.673376] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.673551] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.673637] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.673725] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a13ba64-a593-4798-b668-78791377ba50" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.674348] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a13ba64-a593-4798-b668-78791377ba50 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.674348] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a13ba64-a593-4798-b668-78791377ba50" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.674348] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a13ba64-a593-4798-b668-78791377ba50" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.674348] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a13ba64-a593-4798-b668-78791377ba50" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.674348] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.674545] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.674545] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.674545] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.674639] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.674714] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a13ba64-a593-4798-b668-78791377ba50" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.674787] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8a13ba64-a593-4798-b668-78791377ba50',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.742710] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.742879] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.742967] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.743265] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.743448] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.756439] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed4053b7-493c-48f8-b82e-b002cbcc3a61 in Status: IN_PROGRESS for 2s [ 610.917058] env[65065]: INFO networking_nsxv3.common.synchronization [None req-bc708ad6-83c6-4f90-ae0d-991a18834576 tempest-ServersWithSpecificFlavorTestJSON-1007896152 tempest-ServersWithSpecificFlavorTestJSON-1007896152-project-member] Enqueued Resource ID: 9576b45f-b344-47bd-8f8b-9df4c3725ddb with Priority: HIGHEST for action security_group_rules [ 610.917425] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9576b45f-b344-47bd-8f8b-9df4c3725ddb with Priority: HIGHEST for action security_group_rules [ 610.918063] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9576b45f-b344-47bd-8f8b-9df4c3725ddb taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.918063] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9576b45f-b344-47bd-8f8b-9df4c3725ddb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.928917] env[65065]: INFO networking_nsxv3.common.synchronization [req-0348970b-f25a-42f9-9722-9c46675f674c req-0c32b962-7e4f-4bab-a39b-26673bd7ac12 service nova] Enqueued Resource ID: ed4053b7-493c-48f8-b82e-b002cbcc3a61 with Priority: HIGHEST for action security_group_rules [ 610.928917] env[65065]: INFO networking_nsxv3.common.synchronization [req-0348970b-f25a-42f9-9722-9c46675f674c req-0c32b962-7e4f-4bab-a39b-26673bd7ac12 service nova] Enqueued Resource ID: ed4053b7-493c-48f8-b82e-b002cbcc3a61 with Priority: HIGHEST for action security_group_members [ 610.929193] env[65065]: INFO networking_nsxv3.common.synchronization [req-0348970b-f25a-42f9-9722-9c46675f674c req-0c32b962-7e4f-4bab-a39b-26673bd7ac12 service nova] Enqueued Resource ID: 8501a5a0-b950-43f9-a264-0eef03029573 with Priority: HIGHEST for action port [ 610.929732] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed4053b7-493c-48f8-b82e-b002cbcc3a61 with Priority: HIGHEST for action security_group_rules [ 610.929732] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed4053b7-493c-48f8-b82e-b002cbcc3a61 with Priority: HIGHEST for action security_group_members [ 610.929862] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8501a5a0-b950-43f9-a264-0eef03029573 with Priority: HIGHEST for action port [ 610.930374] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ed4053b7-493c-48f8-b82e-b002cbcc3a61 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.930374] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.930750] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed4053b7-493c-48f8-b82e-b002cbcc3a61 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.930873] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.931052] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-8501a5a0-b950-43f9-a264-0eef03029573 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.931218] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8501a5a0-b950-43f9-a264-0eef03029573" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.931309] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8501a5a0-b950-43f9-a264-0eef03029573" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.931582] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8501a5a0-b950-43f9-a264-0eef03029573" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.931703] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8501a5a0-b950-43f9-a264-0eef03029573',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.177755] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8a13ba64-a593-4798-b668-78791377ba50: rpc.has_security_group_logging(os_id): False [ 611.186162] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.186314] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.186412] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.186598] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.186687] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.186778] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9576b45f-b344-47bd-8f8b-9df4c3725ddb already deleted. [ 611.187030] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9576b45f-b344-47bd-8f8b-9df4c3725ddb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.187191] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9576b45f-b344-47bd-8f8b-9df4c3725ddb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.187356] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9576b45f-b344-47bd-8f8b-9df4c3725ddb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.187460] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9576b45f-b344-47bd-8f8b-9df4c3725ddb',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.198355] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.198500] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.198595] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.198845] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.199016] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.199620] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.199620] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.199620] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.199620] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.199620] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.199884] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.199884] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.200707] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.200707] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.200707] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.200707] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.200707] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.200707] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.200707] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.201048] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.201048] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8a13ba64-a593-4798-b668-78791377ba50 is going to be created. [ 611.289010] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.289222] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.289327] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.289602] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.289814] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.320056] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8a13ba64-a593-4798-b668-78791377ba50 in Status: IN_PROGRESS for 2s [ 611.434530] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8501a5a0-b950-43f9-a264-0eef03029573 with status ACTIVE [ 611.434717] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.434804] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.434907] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.435139] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.435240] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.435498] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.435583] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.435583] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.436152] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.436152] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.436152] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.436152] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.436368] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.436368] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.436458] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.436458] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8501a5a0-b950-43f9-a264-0eef03029573 is going to be updated. [ 611.467330] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.467330] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.467628] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.467628] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.467752] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.467915] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8501a5a0-b950-43f9-a264-0eef03029573" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.541412] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ed4053b7-493c-48f8-b82e-b002cbcc3a61 in Status: SUCCESS [ 611.541720] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.541899] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.542148] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.542254] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ed4053b7-493c-48f8-b82e-b002cbcc3a61',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.716673] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.716882] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.717444] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.717444] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.717533] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.717710] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9576b45f-b344-47bd-8f8b-9df4c3725ddb already deleted. [ 611.717710] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9576b45f-b344-47bd-8f8b-9df4c3725ddb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.045185] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed4053b7-493c-48f8-b82e-b002cbcc3a61 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.047579] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.499122] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5501386c-6d40-4911-b095-561660dd038b in Status: SUCCESS [ 612.499122] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5501386c-6d40-4911-b095-561660dd038b deletion is rescheduled due to dependency. [ 612.499532] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5501386c-6d40-4911-b095-561660dd038b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.561065] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 36b0a7bf-c185-47f8-9c6c-88ed66cc1f56 in Status: SUCCESS [ 612.561065] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-36b0a7bf-c185-47f8-9c6c-88ed66cc1f56" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.561065] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-36b0a7bf-c185-47f8-9c6c-88ed66cc1f56" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.561065] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-36b0a7bf-c185-47f8-9c6c-88ed66cc1f56" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.561065] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.561065] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.561065] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.561065] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.561065] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.561065] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-36b0a7bf-c185-47f8-9c6c-88ed66cc1f56" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.561065] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('36b0a7bf-c185-47f8-9c6c-88ed66cc1f56',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.766178] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed4053b7-493c-48f8-b82e-b002cbcc3a61 in Status: SUCCESS [ 612.766424] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.766550] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.766832] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.767111] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.767273] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.767369] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.767553] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.767673] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.767777] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ed4053b7-493c-48f8-b82e-b002cbcc3a61',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.838117] env[65065]: INFO networking_nsxv3.common.synchronization [req-af827a63-5a53-41f3-9c91-334f4222bba9 req-366862b8-e011-4aba-9123-87454920d237 tempest-MigrationsAdminTest-1843927703 tempest-MigrationsAdminTest-1843927703-project-member] Enqueued Resource ID: 45ff18a7-4a73-49de-af36-6c1d70b047f6 with Priority: HIGHEST for action security_group_members [ 612.838470] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45ff18a7-4a73-49de-af36-6c1d70b047f6 with Priority: HIGHEST for action security_group_members [ 612.839341] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-45ff18a7-4a73-49de-af36-6c1d70b047f6 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.839515] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45ff18a7-4a73-49de-af36-6c1d70b047f6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.839611] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45ff18a7-4a73-49de-af36-6c1d70b047f6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.839891] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45ff18a7-4a73-49de-af36-6c1d70b047f6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.840109] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.840233] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.840354] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.840510] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.840625] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.840749] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('45ff18a7-4a73-49de-af36-6c1d70b047f6',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.982157] env[65065]: INFO networking_nsxv3.common.synchronization [req-4e0211cd-f953-483e-b63b-b49f936ffdee req-17554861-0e54-48ae-bbf0-ec7d9ad9243b tempest-ServerDiagnosticsTest-42737267 tempest-ServerDiagnosticsTest-42737267-project-member] Enqueued Resource ID: afe348a4-4bdc-4830-8b52-3584e5dee837 with Priority: HIGHEST for action security_group_members [ 612.982779] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: afe348a4-4bdc-4830-8b52-3584e5dee837 with Priority: HIGHEST for action security_group_members [ 612.983353] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-afe348a4-4bdc-4830-8b52-3584e5dee837 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.983562] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-afe348a4-4bdc-4830-8b52-3584e5dee837" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.983676] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-afe348a4-4bdc-4830-8b52-3584e5dee837" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.983951] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-afe348a4-4bdc-4830-8b52-3584e5dee837" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.984190] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.984362] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.984476] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.984725] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.985085] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.985085] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('afe348a4-4bdc-4830-8b52-3584e5dee837',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.066023] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-36b0a7bf-c185-47f8-9c6c-88ed66cc1f56 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.066023] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-36b0a7bf-c185-47f8-9c6c-88ed66cc1f56" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.066023] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-36b0a7bf-c185-47f8-9c6c-88ed66cc1f56" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.066023] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-36b0a7bf-c185-47f8-9c6c-88ed66cc1f56" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.066023] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.066023] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.066023] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.066023] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.066023] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.066023] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-36b0a7bf-c185-47f8-9c6c-88ed66cc1f56" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.066023] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-36b0a7bf-c185-47f8-9c6c-88ed66cc1f56 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.066023] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-36b0a7bf-c185-47f8-9c6c-88ed66cc1f56" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.066023] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-36b0a7bf-c185-47f8-9c6c-88ed66cc1f56" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.066023] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-36b0a7bf-c185-47f8-9c6c-88ed66cc1f56" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.066023] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.066023] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.066843] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.066843] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.066843] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.070918] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-36b0a7bf-c185-47f8-9c6c-88ed66cc1f56" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.070918] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('36b0a7bf-c185-47f8-9c6c-88ed66cc1f56',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.270501] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ed4053b7-493c-48f8-b82e-b002cbcc3a61',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.335601] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8a13ba64-a593-4798-b668-78791377ba50 in Status: SUCCESS [ 613.335716] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8a13ba64-a593-4798-b668-78791377ba50" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.346766] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.347247] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.347247] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.347421] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.347421] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.347652] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.347750] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.347813] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.347971] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.348062] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.348150] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45ff18a7-4a73-49de-af36-6c1d70b047f6 already deleted. [ 613.348230] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45ff18a7-4a73-49de-af36-6c1d70b047f6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.488154] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.488299] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.488342] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.488564] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.488658] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.488966] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.488966] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.489084] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.489160] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.489236] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.490194] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: afe348a4-4bdc-4830-8b52-3584e5dee837 is going to be updated. [ 613.528899] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.529405] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.529405] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.529405] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.529597] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.538755] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: afe348a4-4bdc-4830-8b52-3584e5dee837 in Status: IN_PROGRESS for 2s [ 613.567492] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock network-11 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.567745] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "network-11" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.567816] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "network-11" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.568109] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "network-11" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.568577] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.568577] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.568763] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.568851] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.568990] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.569217] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 613.569330] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 613.569460] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 613.569622] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 613.569758] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 613.569923] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 613.570043] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 613.574182] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 36b0a7bf-c185-47f8-9c6c-88ed66cc1f56: rpc.has_security_group_logging(os_id): False [ 613.593481] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 613.593988] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 613.593988] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 613.595162] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "network-11" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.595162] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock port-0afdc260-27d7-41d4-955b-78bad14b0be5 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.595162] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "port-0afdc260-27d7-41d4-955b-78bad14b0be5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.595162] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "port-0afdc260-27d7-41d4-955b-78bad14b0be5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.595447] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "port-0afdc260-27d7-41d4-955b-78bad14b0be5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.595447] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0afdc260-27d7-41d4-955b-78bad14b0be5',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.597221] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.597395] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.597395] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.597806] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.597806] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.598315] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.598315] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.598315] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.598315] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.598458] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.598657] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.598789] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.598856] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.599090] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.599090] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.599892] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.599892] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.599892] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.599892] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.599892] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.599892] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 36b0a7bf-c185-47f8-9c6c-88ed66cc1f56 is going to be created. [ 613.604423] env[65065]: INFO networking_nsxv3.common.synchronization [req-57686db8-02da-4da3-8885-730576ce7d3c req-4c76cfa7-8d67-4f53-99e8-c40de40e55a7 tempest-ServerExternalEventsTest-1266274393 tempest-ServerExternalEventsTest-1266274393-project-member] Enqueued Resource ID: 45d9fbda-3bbf-490e-af96-b968c92e95ba with Priority: HIGHEST for action security_group_members [ 613.605108] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45d9fbda-3bbf-490e-af96-b968c92e95ba with Priority: HIGHEST for action security_group_members [ 613.605524] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-45d9fbda-3bbf-490e-af96-b968c92e95ba taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.605679] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45d9fbda-3bbf-490e-af96-b968c92e95ba" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.605742] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45d9fbda-3bbf-490e-af96-b968c92e95ba" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.605954] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45d9fbda-3bbf-490e-af96-b968c92e95ba" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.606190] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.606364] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.606440] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.606578] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.606682] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.606800] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('45d9fbda-3bbf-490e-af96-b968c92e95ba',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.674571] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.674786] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.674786] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.674927] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.675125] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.687387] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 36b0a7bf-c185-47f8-9c6c-88ed66cc1f56 in Status: IN_PROGRESS for 2s [ 613.774491] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ed4053b7-493c-48f8-b82e-b002cbcc3a61',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.102493] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.102725] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.102846] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.103230] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.103414] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.103574] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Segment Port 0afdc260-27d7-41d4-955b-78bad14b0be5 not found, creating... [ 614.103840] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.104254] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.104350] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.104580] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.104733] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.105121] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.105305] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.105626] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.105790] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.107069] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.107069] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Resource: SegmentPort with ID: 0afdc260-27d7-41d4-955b-78bad14b0be5 is going to be created. [ 614.109574] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.109574] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.109574] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.110320] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.110320] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.110320] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.110702] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.110702] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.110766] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.110860] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.110968] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45d9fbda-3bbf-490e-af96-b968c92e95ba is going to be updated. [ 614.139751] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.139751] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.139751] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.140075] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.140417] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.140759] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "port-0afdc260-27d7-41d4-955b-78bad14b0be5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.152120] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.153336] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.153336] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.153336] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.153336] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.170067] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45d9fbda-3bbf-490e-af96-b968c92e95ba in Status: IN_PROGRESS for 2s [ 614.277536] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.277536] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.277536] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.277824] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.277924] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.277972] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ed4053b7-493c-48f8-b82e-b002cbcc3a61 is going to be updated. [ 614.314948] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.315277] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.315472] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.315752] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.315979] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.329205] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed4053b7-493c-48f8-b82e-b002cbcc3a61 in Status: IN_PROGRESS for 2s [ 615.213476] env[65065]: INFO networking_nsxv3.common.synchronization [req-c237a19b-c5fc-4494-bdde-8625ff29785a req-2fab98cd-784b-41da-aa87-bd79b334d402 tempest-VolumesAssistedSnapshotsTest-1337089844 tempest-VolumesAssistedSnapshotsTest-1337089844-project-member] Enqueued Resource ID: d38273aa-e7d2-4aea-bcb1-2f5ae899e71f with Priority: HIGHEST for action security_group_members [ 615.213476] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d38273aa-e7d2-4aea-bcb1-2f5ae899e71f with Priority: HIGHEST for action security_group_members [ 615.213476] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-d38273aa-e7d2-4aea-bcb1-2f5ae899e71f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.213476] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d38273aa-e7d2-4aea-bcb1-2f5ae899e71f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.213476] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d38273aa-e7d2-4aea-bcb1-2f5ae899e71f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.213476] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d38273aa-e7d2-4aea-bcb1-2f5ae899e71f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.213476] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.213476] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.213476] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.213476] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.213476] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.213476] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d38273aa-e7d2-4aea-bcb1-2f5ae899e71f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.307821] env[65065]: INFO networking_nsxv3.common.synchronization [req-af827a63-5a53-41f3-9c91-334f4222bba9 req-bf052ff1-65e4-4240-88d7-72a17c6668ea service nova] Enqueued Resource ID: 45ff18a7-4a73-49de-af36-6c1d70b047f6 with Priority: HIGHEST for action security_group_rules [ 615.308123] env[65065]: INFO networking_nsxv3.common.synchronization [req-af827a63-5a53-41f3-9c91-334f4222bba9 req-bf052ff1-65e4-4240-88d7-72a17c6668ea service nova] Enqueued Resource ID: 45ff18a7-4a73-49de-af36-6c1d70b047f6 with Priority: HIGHEST for action security_group_members [ 615.308410] env[65065]: INFO networking_nsxv3.common.synchronization [req-af827a63-5a53-41f3-9c91-334f4222bba9 req-bf052ff1-65e4-4240-88d7-72a17c6668ea service nova] Enqueued Resource ID: 0afdc260-27d7-41d4-955b-78bad14b0be5 with Priority: HIGHEST for action port [ 615.310351] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45ff18a7-4a73-49de-af36-6c1d70b047f6 with Priority: HIGHEST for action security_group_rules [ 615.310490] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45ff18a7-4a73-49de-af36-6c1d70b047f6 with Priority: HIGHEST for action security_group_members [ 615.310652] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0afdc260-27d7-41d4-955b-78bad14b0be5 with Priority: HIGHEST for action port [ 615.310948] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-45ff18a7-4a73-49de-af36-6c1d70b047f6 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.311124] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-45ff18a7-4a73-49de-af36-6c1d70b047f6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.311198] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-45ff18a7-4a73-49de-af36-6c1d70b047f6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.311922] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-45ff18a7-4a73-49de-af36-6c1d70b047f6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.311922] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('45ff18a7-4a73-49de-af36-6c1d70b047f6',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.312608] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-45ff18a7-4a73-49de-af36-6c1d70b047f6 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.312798] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45ff18a7-4a73-49de-af36-6c1d70b047f6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.312998] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45ff18a7-4a73-49de-af36-6c1d70b047f6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.313446] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45ff18a7-4a73-49de-af36-6c1d70b047f6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.313638] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.313747] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.314106] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.316012] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.316012] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.316012] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('45ff18a7-4a73-49de-af36-6c1d70b047f6',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.316012] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-0afdc260-27d7-41d4-955b-78bad14b0be5 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.316012] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0afdc260-27d7-41d4-955b-78bad14b0be5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.316012] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0afdc260-27d7-41d4-955b-78bad14b0be5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.316012] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0afdc260-27d7-41d4-955b-78bad14b0be5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.316012] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0afdc260-27d7-41d4-955b-78bad14b0be5',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.550740] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: afe348a4-4bdc-4830-8b52-3584e5dee837 in Status: SUCCESS [ 615.550993] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: afe348a4-4bdc-4830-8b52-3584e5dee837 deletion is rescheduled due to dependency. [ 615.551163] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-afe348a4-4bdc-4830-8b52-3584e5dee837" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.707266] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 36b0a7bf-c185-47f8-9c6c-88ed66cc1f56 in Status: SUCCESS [ 615.707266] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-36b0a7bf-c185-47f8-9c6c-88ed66cc1f56" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.718502] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.718502] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.718502] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.718502] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.718721] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.718978] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.719133] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.719231] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.719446] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.719581] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.719711] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d38273aa-e7d2-4aea-bcb1-2f5ae899e71f already deleted. [ 615.719831] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d38273aa-e7d2-4aea-bcb1-2f5ae899e71f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.737524] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock network-196 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.737948] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "network-196" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.738103] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "network-196" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.739065] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "network-196" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.740896] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.740896] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.740896] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.740896] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.741224] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.741327] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 615.741482] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 615.741646] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 615.741725] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 615.742220] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 615.742220] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 615.742220] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 615.767613] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 615.767613] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 615.767613] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 615.767613] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "network-196" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.767613] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock port-3e746981-b2b4-46d0-9a61-67b5de86bc6b taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.768498] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "port-3e746981-b2b4-46d0-9a61-67b5de86bc6b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.768731] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "port-3e746981-b2b4-46d0-9a61-67b5de86bc6b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.769183] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "port-3e746981-b2b4-46d0-9a61-67b5de86bc6b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.769439] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e746981-b2b4-46d0-9a61-67b5de86bc6b',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.818359] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-45ff18a7-4a73-49de-af36-6c1d70b047f6 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.818359] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45ff18a7-4a73-49de-af36-6c1d70b047f6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.818880] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('45ff18a7-4a73-49de-af36-6c1d70b047f6',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.819910] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0afdc260-27d7-41d4-955b-78bad14b0be5 with status ACTIVE [ 615.820182] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.820359] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.820438] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.820680] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.820755] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.821309] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.821309] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.821309] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.821309] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.821527] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.821833] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.821833] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.822017] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.822162] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.822162] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.822391] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0afdc260-27d7-41d4-955b-78bad14b0be5 is going to be updated. [ 615.848706] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.848921] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.849046] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.849319] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.849505] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.849711] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0afdc260-27d7-41d4-955b-78bad14b0be5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.180205] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45d9fbda-3bbf-490e-af96-b968c92e95ba in Status: SUCCESS [ 616.180377] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45d9fbda-3bbf-490e-af96-b968c92e95ba deletion is rescheduled due to dependency. [ 616.180499] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45d9fbda-3bbf-490e-af96-b968c92e95ba" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.274941] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.274941] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.274941] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.274941] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.274941] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.274941] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Segment Port 3e746981-b2b4-46d0-9a61-67b5de86bc6b not found, creating... [ 616.274941] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.274941] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.274941] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.274941] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.274941] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.275768] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.275989] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.276543] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.276858] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.277223] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.277462] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Resource: SegmentPort with ID: 3e746981-b2b4-46d0-9a61-67b5de86bc6b is going to be created. [ 616.301791] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.302108] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.302312] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.302672] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.302981] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.303292] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "port-3e746981-b2b4-46d0-9a61-67b5de86bc6b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.324549] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('45ff18a7-4a73-49de-af36-6c1d70b047f6',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.340197] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed4053b7-493c-48f8-b82e-b002cbcc3a61 in Status: SUCCESS [ 616.340407] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.340572] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.340788] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.340983] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.341107] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.341174] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.341346] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.341444] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.341540] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.341635] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ed4053b7-493c-48f8-b82e-b002cbcc3a61',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.827794] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.827794] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.827794] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.828227] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.828227] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.828508] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45ff18a7-4a73-49de-af36-6c1d70b047f6 is going to be created. [ 616.843479] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed4053b7-493c-48f8-b82e-b002cbcc3a61 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.843693] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.843744] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.843931] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.844267] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.844267] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.844267] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.844619] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.844734] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.844827] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.844999] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed4053b7-493c-48f8-b82e-b002cbcc3a61 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.845112] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.845173] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.845321] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.845461] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.845550] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.845612] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.845748] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.845826] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.845910] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.845999] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ed4053b7-493c-48f8-b82e-b002cbcc3a61',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.857973] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.857973] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.857973] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.857973] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.857973] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.872140] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45ff18a7-4a73-49de-af36-6c1d70b047f6 in Status: UNINITIALIZED for 2s [ 617.029513] env[65065]: INFO networking_nsxv3.common.synchronization [req-c237a19b-c5fc-4494-bdde-8625ff29785a req-c8b59305-a3cf-45e1-aab2-97bb39a04a54 service nova] Enqueued Resource ID: d38273aa-e7d2-4aea-bcb1-2f5ae899e71f with Priority: HIGHEST for action security_group_rules [ 617.029763] env[65065]: INFO networking_nsxv3.common.synchronization [req-c237a19b-c5fc-4494-bdde-8625ff29785a req-c8b59305-a3cf-45e1-aab2-97bb39a04a54 service nova] Enqueued Resource ID: d38273aa-e7d2-4aea-bcb1-2f5ae899e71f with Priority: HIGHEST for action security_group_members [ 617.029948] env[65065]: INFO networking_nsxv3.common.synchronization [req-c237a19b-c5fc-4494-bdde-8625ff29785a req-c8b59305-a3cf-45e1-aab2-97bb39a04a54 service nova] Enqueued Resource ID: 3e746981-b2b4-46d0-9a61-67b5de86bc6b with Priority: HIGHEST for action port [ 617.030879] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d38273aa-e7d2-4aea-bcb1-2f5ae899e71f with Priority: HIGHEST for action security_group_rules [ 617.031080] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d38273aa-e7d2-4aea-bcb1-2f5ae899e71f with Priority: HIGHEST for action security_group_members [ 617.031229] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e746981-b2b4-46d0-9a61-67b5de86bc6b with Priority: HIGHEST for action port [ 617.031802] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d38273aa-e7d2-4aea-bcb1-2f5ae899e71f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.032906] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d38273aa-e7d2-4aea-bcb1-2f5ae899e71f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.033059] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d38273aa-e7d2-4aea-bcb1-2f5ae899e71f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.033248] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d38273aa-e7d2-4aea-bcb1-2f5ae899e71f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.033295] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d38273aa-e7d2-4aea-bcb1-2f5ae899e71f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.034173] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-d38273aa-e7d2-4aea-bcb1-2f5ae899e71f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.034297] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d38273aa-e7d2-4aea-bcb1-2f5ae899e71f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.034347] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d38273aa-e7d2-4aea-bcb1-2f5ae899e71f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.034523] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d38273aa-e7d2-4aea-bcb1-2f5ae899e71f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.034666] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.034758] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.034817] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.035146] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.035217] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.035310] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d38273aa-e7d2-4aea-bcb1-2f5ae899e71f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.036401] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-3e746981-b2b4-46d0-9a61-67b5de86bc6b taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.036509] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3e746981-b2b4-46d0-9a61-67b5de86bc6b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.037469] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3e746981-b2b4-46d0-9a61-67b5de86bc6b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.037469] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3e746981-b2b4-46d0-9a61-67b5de86bc6b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.037469] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e746981-b2b4-46d0-9a61-67b5de86bc6b',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.351440] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ed4053b7-493c-48f8-b82e-b002cbcc3a61: rpc.has_security_group_logging(os_id): False [ 617.372359] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.372359] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.372359] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.372359] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.372359] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.372359] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.372359] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.372359] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.372732] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.372732] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.372732] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.372732] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.372919] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.372919] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.372983] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.373191] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.373297] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.373297] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.373514] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.373514] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.373680] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ed4053b7-493c-48f8-b82e-b002cbcc3a61 is going to be updated. [ 617.441683] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.441975] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.441975] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.442668] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.442668] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.461582] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ed4053b7-493c-48f8-b82e-b002cbcc3a61 in Status: IN_PROGRESS for 2s [ 617.541358] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d38273aa-e7d2-4aea-bcb1-2f5ae899e71f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.541358] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-d38273aa-e7d2-4aea-bcb1-2f5ae899e71f taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.541358] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d38273aa-e7d2-4aea-bcb1-2f5ae899e71f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.541358] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3e746981-b2b4-46d0-9a61-67b5de86bc6b with status ACTIVE [ 617.541358] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.541358] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.541358] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.541358] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.541358] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.541358] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.541358] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.541358] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.542752] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.542989] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.543504] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.543805] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.544017] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.544383] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.544552] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.544755] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3e746981-b2b4-46d0-9a61-67b5de86bc6b is going to be updated. [ 617.600619] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.600619] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.600619] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.600619] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.600619] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.600619] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3e746981-b2b4-46d0-9a61-67b5de86bc6b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.624178] env[65065]: INFO networking_nsxv3.common.synchronization [req-ebea1f9a-d819-4fba-a738-86679a966d12 req-fa7b1167-50f2-43dd-b4ba-9d236595ea52 tempest-ImagesOneServerTestJSON-427268011 tempest-ImagesOneServerTestJSON-427268011-project-member] Enqueued Resource ID: c264aab4-0245-4fdf-8152-a3476b7dd553 with Priority: HIGHEST for action security_group_members [ 617.626731] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c264aab4-0245-4fdf-8152-a3476b7dd553 with Priority: HIGHEST for action security_group_members [ 617.626731] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-c264aab4-0245-4fdf-8152-a3476b7dd553 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.626903] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c264aab4-0245-4fdf-8152-a3476b7dd553" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.626946] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c264aab4-0245-4fdf-8152-a3476b7dd553" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.627837] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c264aab4-0245-4fdf-8152-a3476b7dd553" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.629226] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.629226] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.629226] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.629226] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.629226] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.629226] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c264aab4-0245-4fdf-8152-a3476b7dd553',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.896978] env[65065]: INFO networking_nsxv3.common.synchronization [None req-d606db13-31b5-4da1-b04a-a990271c917d None None] Enqueued Resource ID: 8ed14737-9e34-4417-9eec-156ab40de267 with Priority: HIGHEST for action port [ 617.898439] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ed14737-9e34-4417-9eec-156ab40de267 with Priority: HIGHEST for action port [ 617.898936] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-8ed14737-9e34-4417-9eec-156ab40de267 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.899283] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8ed14737-9e34-4417-9eec-156ab40de267" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.900592] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8ed14737-9e34-4417-9eec-156ab40de267" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.902926] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8ed14737-9e34-4417-9eec-156ab40de267" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.902926] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8ed14737-9e34-4417-9eec-156ab40de267',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.051743] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d38273aa-e7d2-4aea-bcb1-2f5ae899e71f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.132688] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.132688] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.132688] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.132688] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.132688] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.132688] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.132688] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.132688] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.132688] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.132688] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.132688] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c264aab4-0245-4fdf-8152-a3476b7dd553 already deleted. [ 618.132688] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c264aab4-0245-4fdf-8152-a3476b7dd553" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.404379] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8ed14737-9e34-4417-9eec-156ab40de267 [ 618.405452] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.405452] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.405452] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.405452] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.405452] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.405452] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8ed14737-9e34-4417-9eec-156ab40de267 already deleted. [ 618.405452] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8ed14737-9e34-4417-9eec-156ab40de267" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.453799] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock network-940 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.453799] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "network-940" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.453799] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "network-940" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.454486] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "network-940" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.455567] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.456519] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.456519] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.456649] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.456803] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.457261] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 618.457404] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 618.457528] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 618.457633] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 618.457740] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 618.457840] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 618.458023] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 618.481248] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 618.481248] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 618.481248] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 618.481248] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "network-940" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.481248] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock port-2ceb6f72-05b4-4a8f-80de-d1bc21518b41 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.481248] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "port-2ceb6f72-05b4-4a8f-80de-d1bc21518b41" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.481248] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "port-2ceb6f72-05b4-4a8f-80de-d1bc21518b41" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.481248] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "port-2ceb6f72-05b4-4a8f-80de-d1bc21518b41" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.481248] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2ceb6f72-05b4-4a8f-80de-d1bc21518b41',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.554298] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.554733] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.554733] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.554733] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.554942] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.554942] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d38273aa-e7d2-4aea-bcb1-2f5ae899e71f is going to be created. [ 618.583875] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.584191] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.584366] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.584710] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.585037] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.601025] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d38273aa-e7d2-4aea-bcb1-2f5ae899e71f in Status: UNINITIALIZED for 2s [ 618.766324] env[65065]: INFO networking_nsxv3.common.synchronization [None req-5c6ffb38-9f89-45c0-9c4b-8f13910a7866 None None] Enqueued Resource ID: e6c560ce-62d4-45d3-a32a-9dd88e8c9af9 with Priority: HIGHEST for action port [ 618.766324] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6c560ce-62d4-45d3-a32a-9dd88e8c9af9 with Priority: HIGHEST for action port [ 618.766324] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-e6c560ce-62d4-45d3-a32a-9dd88e8c9af9 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.766324] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e6c560ce-62d4-45d3-a32a-9dd88e8c9af9" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.766324] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e6c560ce-62d4-45d3-a32a-9dd88e8c9af9" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.768049] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e6c560ce-62d4-45d3-a32a-9dd88e8c9af9" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.768154] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e6c560ce-62d4-45d3-a32a-9dd88e8c9af9',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.886351] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45ff18a7-4a73-49de-af36-6c1d70b047f6 in Status: SUCCESS [ 618.886693] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45ff18a7-4a73-49de-af36-6c1d70b047f6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.886932] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45ff18a7-4a73-49de-af36-6c1d70b047f6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.887453] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45ff18a7-4a73-49de-af36-6c1d70b047f6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.887703] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.887867] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.887960] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.888179] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.888292] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.888410] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45ff18a7-4a73-49de-af36-6c1d70b047f6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.888529] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('45ff18a7-4a73-49de-af36-6c1d70b047f6',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.983505] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.983790] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.986180] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.986180] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.986180] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.986180] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Segment Port 2ceb6f72-05b4-4a8f-80de-d1bc21518b41 not found, creating... [ 618.986180] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.986180] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.986180] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.986180] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.986180] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.986492] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.986572] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.986677] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.987190] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.987372] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.987541] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Resource: SegmentPort with ID: 2ceb6f72-05b4-4a8f-80de-d1bc21518b41 is going to be created. [ 619.010028] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.010028] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.010028] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.010028] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.010028] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.010028] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "port-2ceb6f72-05b4-4a8f-80de-d1bc21518b41" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.270099] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e6c560ce-62d4-45d3-a32a-9dd88e8c9af9 [ 619.270352] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.270498] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.270564] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.270789] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.270877] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.270974] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e6c560ce-62d4-45d3-a32a-9dd88e8c9af9 already deleted. [ 619.271559] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e6c560ce-62d4-45d3-a32a-9dd88e8c9af9" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.391460] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-45ff18a7-4a73-49de-af36-6c1d70b047f6 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.392305] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45ff18a7-4a73-49de-af36-6c1d70b047f6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.392392] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45ff18a7-4a73-49de-af36-6c1d70b047f6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.393029] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45ff18a7-4a73-49de-af36-6c1d70b047f6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.393029] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.393029] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.393029] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.393267] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.393267] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.393360] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45ff18a7-4a73-49de-af36-6c1d70b047f6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.393473] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-45ff18a7-4a73-49de-af36-6c1d70b047f6 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.393577] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45ff18a7-4a73-49de-af36-6c1d70b047f6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.393638] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45ff18a7-4a73-49de-af36-6c1d70b047f6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.393779] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45ff18a7-4a73-49de-af36-6c1d70b047f6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.393915] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.394008] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.394087] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.394256] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.394338] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.394419] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45ff18a7-4a73-49de-af36-6c1d70b047f6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.394510] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('45ff18a7-4a73-49de-af36-6c1d70b047f6',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.478230] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ed4053b7-493c-48f8-b82e-b002cbcc3a61 in Status: SUCCESS [ 619.478687] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.750958] env[65065]: INFO networking_nsxv3.common.synchronization [req-ebea1f9a-d819-4fba-a738-86679a966d12 req-1976cd47-a311-4459-93d3-8b7f60ba813e service nova] Enqueued Resource ID: c264aab4-0245-4fdf-8152-a3476b7dd553 with Priority: HIGHEST for action security_group_rules [ 619.751324] env[65065]: INFO networking_nsxv3.common.synchronization [req-ebea1f9a-d819-4fba-a738-86679a966d12 req-1976cd47-a311-4459-93d3-8b7f60ba813e service nova] Enqueued Resource ID: c264aab4-0245-4fdf-8152-a3476b7dd553 with Priority: HIGHEST for action security_group_members [ 619.751324] env[65065]: INFO networking_nsxv3.common.synchronization [req-ebea1f9a-d819-4fba-a738-86679a966d12 req-1976cd47-a311-4459-93d3-8b7f60ba813e service nova] Enqueued Resource ID: 2ceb6f72-05b4-4a8f-80de-d1bc21518b41 with Priority: HIGHEST for action port [ 619.751907] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c264aab4-0245-4fdf-8152-a3476b7dd553 with Priority: HIGHEST for action security_group_rules [ 619.753489] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c264aab4-0245-4fdf-8152-a3476b7dd553 with Priority: HIGHEST for action security_group_members [ 619.753489] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ceb6f72-05b4-4a8f-80de-d1bc21518b41 with Priority: HIGHEST for action port [ 619.753489] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c264aab4-0245-4fdf-8152-a3476b7dd553 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.753489] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c264aab4-0245-4fdf-8152-a3476b7dd553" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.753489] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c264aab4-0245-4fdf-8152-a3476b7dd553" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.754428] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c264aab4-0245-4fdf-8152-a3476b7dd553" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.754428] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c264aab4-0245-4fdf-8152-a3476b7dd553',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.758347] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-c264aab4-0245-4fdf-8152-a3476b7dd553 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.758347] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c264aab4-0245-4fdf-8152-a3476b7dd553" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.758347] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c264aab4-0245-4fdf-8152-a3476b7dd553" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.758347] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c264aab4-0245-4fdf-8152-a3476b7dd553" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.758347] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.758347] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.758347] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.758347] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.758347] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.758347] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c264aab4-0245-4fdf-8152-a3476b7dd553',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.758698] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-2ceb6f72-05b4-4a8f-80de-d1bc21518b41 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.758698] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2ceb6f72-05b4-4a8f-80de-d1bc21518b41" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.758792] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2ceb6f72-05b4-4a8f-80de-d1bc21518b41" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.759151] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2ceb6f72-05b4-4a8f-80de-d1bc21518b41" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.759151] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2ceb6f72-05b4-4a8f-80de-d1bc21518b41',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.773506] env[65065]: INFO networking_nsxv3.common.synchronization [None req-62b30bc9-ab4b-47e0-9ae3-a1188cb64e93 None None] Enqueued Resource ID: 1fc91153-127d-43b3-8c62-910cd9b9f40d with Priority: HIGHEST for action port [ 619.774876] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1fc91153-127d-43b3-8c62-910cd9b9f40d with Priority: HIGHEST for action port [ 619.775488] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-1fc91153-127d-43b3-8c62-910cd9b9f40d taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.775642] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1fc91153-127d-43b3-8c62-910cd9b9f40d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.775745] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1fc91153-127d-43b3-8c62-910cd9b9f40d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.776060] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1fc91153-127d-43b3-8c62-910cd9b9f40d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.776199] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1fc91153-127d-43b3-8c62-910cd9b9f40d',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.896382] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 45ff18a7-4a73-49de-af36-6c1d70b047f6: rpc.has_security_group_logging(os_id): False [ 619.914906] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.915377] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.915456] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.916549] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.916776] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.917318] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.917417] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.917454] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.917689] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.917723] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.918109] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.918210] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.918273] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.918416] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.918560] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.918781] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.918905] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.919035] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.919202] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.919282] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.919369] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 45ff18a7-4a73-49de-af36-6c1d70b047f6 is going to be created. [ 619.990088] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.990312] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.990425] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.990743] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.991066] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.002756] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 45ff18a7-4a73-49de-af36-6c1d70b047f6 in Status: IN_PROGRESS for 2s [ 620.261582] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-c264aab4-0245-4fdf-8152-a3476b7dd553 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.261792] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c264aab4-0245-4fdf-8152-a3476b7dd553" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.263083] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c264aab4-0245-4fdf-8152-a3476b7dd553',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.266294] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2ceb6f72-05b4-4a8f-80de-d1bc21518b41 with status ACTIVE [ 620.266294] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.266294] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.266294] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.266294] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.266294] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.266294] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.266294] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.266294] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.266294] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.266900] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.266900] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.267059] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.267234] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.268195] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.268195] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.268195] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2ceb6f72-05b4-4a8f-80de-d1bc21518b41 is going to be updated. [ 620.281112] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1fc91153-127d-43b3-8c62-910cd9b9f40d [ 620.281493] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.281716] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.281864] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.282853] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.282853] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.282853] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1fc91153-127d-43b3-8c62-910cd9b9f40d already deleted. [ 620.282853] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1fc91153-127d-43b3-8c62-910cd9b9f40d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.295073] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.295588] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.295588] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.295588] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.295746] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.295876] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2ceb6f72-05b4-4a8f-80de-d1bc21518b41" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.403227] env[65065]: INFO networking_nsxv3.common.synchronization [req-8c0d3d22-6f2c-461d-98ad-f0fae9ca509b req-d792f5ea-e035-4749-b476-da9e9132536f tempest-ServersTestJSON-528503202 tempest-ServersTestJSON-528503202-project-member] Enqueued Resource ID: 16e2d0aa-9161-41ee-99b8-486218dfa51d with Priority: HIGHEST for action security_group_members [ 620.403227] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16e2d0aa-9161-41ee-99b8-486218dfa51d with Priority: HIGHEST for action security_group_members [ 620.403227] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-16e2d0aa-9161-41ee-99b8-486218dfa51d taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.403227] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16e2d0aa-9161-41ee-99b8-486218dfa51d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.403227] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16e2d0aa-9161-41ee-99b8-486218dfa51d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.403227] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16e2d0aa-9161-41ee-99b8-486218dfa51d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.404222] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.406542] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.406542] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.406542] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.406542] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.406542] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('16e2d0aa-9161-41ee-99b8-486218dfa51d',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.610243] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d38273aa-e7d2-4aea-bcb1-2f5ae899e71f in Status: SUCCESS [ 620.610555] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d38273aa-e7d2-4aea-bcb1-2f5ae899e71f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.611588] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d38273aa-e7d2-4aea-bcb1-2f5ae899e71f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.612676] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d38273aa-e7d2-4aea-bcb1-2f5ae899e71f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.612899] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.613072] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.613168] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.613407] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.613516] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.613609] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d38273aa-e7d2-4aea-bcb1-2f5ae899e71f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.613750] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d38273aa-e7d2-4aea-bcb1-2f5ae899e71f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.770379] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c264aab4-0245-4fdf-8152-a3476b7dd553',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.776029] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock network-564 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.776029] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "network-564" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.776029] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "network-564" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.776029] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "network-564" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.776404] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.776404] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.776404] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.776730] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.776839] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.777452] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 620.777452] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 620.777452] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 620.777452] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 620.777812] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 620.777812] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 620.777812] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 620.787348] env[65065]: INFO networking_nsxv3.common.synchronization [None req-833996f3-b0fc-45eb-af1e-b6444d29c3c8 None None] Enqueued Resource ID: 3e75eb54-fdac-4525-9a1b-bb735c23710d with Priority: HIGHEST for action port [ 620.788210] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e75eb54-fdac-4525-9a1b-bb735c23710d with Priority: HIGHEST for action port [ 620.788644] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-3e75eb54-fdac-4525-9a1b-bb735c23710d taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.788810] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3e75eb54-fdac-4525-9a1b-bb735c23710d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.788855] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3e75eb54-fdac-4525-9a1b-bb735c23710d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.789139] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3e75eb54-fdac-4525-9a1b-bb735c23710d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.789264] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e75eb54-fdac-4525-9a1b-bb735c23710d',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.803574] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 620.803574] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 620.803574] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 620.803574] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "network-564" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.803574] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock port-dad06109-4f16-4e1c-9d22-cd0f365be3ee taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.803574] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "port-dad06109-4f16-4e1c-9d22-cd0f365be3ee" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.803574] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "port-dad06109-4f16-4e1c-9d22-cd0f365be3ee" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.803574] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "port-dad06109-4f16-4e1c-9d22-cd0f365be3ee" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.805364] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dad06109-4f16-4e1c-9d22-cd0f365be3ee',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.917501] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.917743] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.917743] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.918072] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.920086] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.920458] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.920458] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.920458] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.920773] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.920773] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.920871] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16e2d0aa-9161-41ee-99b8-486218dfa51d already deleted. [ 620.921103] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16e2d0aa-9161-41ee-99b8-486218dfa51d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.118271] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d38273aa-e7d2-4aea-bcb1-2f5ae899e71f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.280858] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.281781] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.281781] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.283434] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.283434] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.283434] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c264aab4-0245-4fdf-8152-a3476b7dd553 is going to be created. [ 621.296678] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3e75eb54-fdac-4525-9a1b-bb735c23710d [ 621.296678] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.296678] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.296678] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.297143] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.297143] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.297356] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3e75eb54-fdac-4525-9a1b-bb735c23710d already deleted. [ 621.297731] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3e75eb54-fdac-4525-9a1b-bb735c23710d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.310183] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.310670] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.310670] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.310858] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.311018] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.311387] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Segment Port dad06109-4f16-4e1c-9d22-cd0f365be3ee not found, creating... [ 621.311466] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.311642] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.311825] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.312023] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.312221] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.312470] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.312632] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.312753] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.313238] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.313312] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.313452] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Resource: SegmentPort with ID: dad06109-4f16-4e1c-9d22-cd0f365be3ee is going to be created. [ 621.315976] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.316959] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.316959] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.316959] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.316959] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.327415] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c264aab4-0245-4fdf-8152-a3476b7dd553 in Status: UNINITIALIZED for 2s [ 621.338251] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.338608] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.338608] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.338858] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.339095] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.339310] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "port-dad06109-4f16-4e1c-9d22-cd0f365be3ee" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.621092] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d38273aa-e7d2-4aea-bcb1-2f5ae899e71f: rpc.has_security_group_logging(os_id): False [ 621.647676] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.647676] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.647676] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.647912] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.647912] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.648274] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.648274] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.648434] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.648468] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.648563] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.648628] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d38273aa-e7d2-4aea-bcb1-2f5ae899e71f is going to be created. [ 621.724576] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.725764] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.725872] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.726198] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.726429] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.739376] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d38273aa-e7d2-4aea-bcb1-2f5ae899e71f in Status: IN_PROGRESS for 2s [ 622.019024] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 45ff18a7-4a73-49de-af36-6c1d70b047f6 in Status: SUCCESS [ 622.019293] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-45ff18a7-4a73-49de-af36-6c1d70b047f6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.100651] env[65065]: INFO networking_nsxv3.common.synchronization [req-8c0d3d22-6f2c-461d-98ad-f0fae9ca509b req-329ee65a-69ae-44de-a16d-d519fb9513e8 service nova] Enqueued Resource ID: 16e2d0aa-9161-41ee-99b8-486218dfa51d with Priority: HIGHEST for action security_group_rules [ 622.100984] env[65065]: INFO networking_nsxv3.common.synchronization [req-8c0d3d22-6f2c-461d-98ad-f0fae9ca509b req-329ee65a-69ae-44de-a16d-d519fb9513e8 service nova] Enqueued Resource ID: 16e2d0aa-9161-41ee-99b8-486218dfa51d with Priority: HIGHEST for action security_group_members [ 622.100984] env[65065]: INFO networking_nsxv3.common.synchronization [req-8c0d3d22-6f2c-461d-98ad-f0fae9ca509b req-329ee65a-69ae-44de-a16d-d519fb9513e8 service nova] Enqueued Resource ID: dad06109-4f16-4e1c-9d22-cd0f365be3ee with Priority: HIGHEST for action port [ 622.101536] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16e2d0aa-9161-41ee-99b8-486218dfa51d with Priority: HIGHEST for action security_group_rules [ 622.101673] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16e2d0aa-9161-41ee-99b8-486218dfa51d with Priority: HIGHEST for action security_group_members [ 622.101771] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dad06109-4f16-4e1c-9d22-cd0f365be3ee with Priority: HIGHEST for action port [ 622.102920] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-16e2d0aa-9161-41ee-99b8-486218dfa51d taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.102920] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-16e2d0aa-9161-41ee-99b8-486218dfa51d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.102920] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-16e2d0aa-9161-41ee-99b8-486218dfa51d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.103183] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-16e2d0aa-9161-41ee-99b8-486218dfa51d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.103244] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('16e2d0aa-9161-41ee-99b8-486218dfa51d',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.104576] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-16e2d0aa-9161-41ee-99b8-486218dfa51d taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.104698] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16e2d0aa-9161-41ee-99b8-486218dfa51d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.104949] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16e2d0aa-9161-41ee-99b8-486218dfa51d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.104949] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16e2d0aa-9161-41ee-99b8-486218dfa51d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.105148] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.105235] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.105294] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.105434] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.105541] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.105640] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('16e2d0aa-9161-41ee-99b8-486218dfa51d',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.108976] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-dad06109-4f16-4e1c-9d22-cd0f365be3ee taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.109157] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dad06109-4f16-4e1c-9d22-cd0f365be3ee" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.113024] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dad06109-4f16-4e1c-9d22-cd0f365be3ee" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.113024] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dad06109-4f16-4e1c-9d22-cd0f365be3ee" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.113024] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dad06109-4f16-4e1c-9d22-cd0f365be3ee',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.611316] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('16e2d0aa-9161-41ee-99b8-486218dfa51d',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.612490] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-16e2d0aa-9161-41ee-99b8-486218dfa51d taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.612606] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16e2d0aa-9161-41ee-99b8-486218dfa51d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.612929] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dad06109-4f16-4e1c-9d22-cd0f365be3ee with status ACTIVE [ 622.614034] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.614034] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.614034] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.614034] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.614034] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.614034] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.614034] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.614034] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.614034] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.614034] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.614520] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.614520] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.614520] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.614520] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.614520] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.614682] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dad06109-4f16-4e1c-9d22-cd0f365be3ee is going to be updated. [ 622.637814] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.638110] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.638110] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.638447] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.638548] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.638760] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dad06109-4f16-4e1c-9d22-cd0f365be3ee" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.114551] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('16e2d0aa-9161-41ee-99b8-486218dfa51d',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.338933] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c264aab4-0245-4fdf-8152-a3476b7dd553 in Status: SUCCESS [ 623.339388] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c264aab4-0245-4fdf-8152-a3476b7dd553" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.339388] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c264aab4-0245-4fdf-8152-a3476b7dd553" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.339677] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c264aab4-0245-4fdf-8152-a3476b7dd553" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.339894] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.340052] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.340121] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.340381] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.340602] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.340602] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c264aab4-0245-4fdf-8152-a3476b7dd553" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.340718] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c264aab4-0245-4fdf-8152-a3476b7dd553',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.618999] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.619181] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.619253] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.619536] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.619645] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.619689] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16e2d0aa-9161-41ee-99b8-486218dfa51d is going to be created. [ 623.646962] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.647372] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.647372] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.647522] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.647659] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.658512] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16e2d0aa-9161-41ee-99b8-486218dfa51d in Status: UNINITIALIZED for 2s [ 623.753409] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d38273aa-e7d2-4aea-bcb1-2f5ae899e71f in Status: SUCCESS [ 623.753663] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d38273aa-e7d2-4aea-bcb1-2f5ae899e71f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.844998] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-c264aab4-0245-4fdf-8152-a3476b7dd553 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.844998] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c264aab4-0245-4fdf-8152-a3476b7dd553" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.844998] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c264aab4-0245-4fdf-8152-a3476b7dd553" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.844998] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c264aab4-0245-4fdf-8152-a3476b7dd553" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.844998] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.844998] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.844998] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.844998] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.844998] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.845765] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c264aab4-0245-4fdf-8152-a3476b7dd553" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.845765] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-c264aab4-0245-4fdf-8152-a3476b7dd553 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.845765] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c264aab4-0245-4fdf-8152-a3476b7dd553" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.845765] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c264aab4-0245-4fdf-8152-a3476b7dd553" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.846023] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c264aab4-0245-4fdf-8152-a3476b7dd553" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.846144] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.846310] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.846427] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.846531] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.846615] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.846704] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c264aab4-0245-4fdf-8152-a3476b7dd553" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.846799] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c264aab4-0245-4fdf-8152-a3476b7dd553',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.349907] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c264aab4-0245-4fdf-8152-a3476b7dd553: rpc.has_security_group_logging(os_id): False [ 624.372991] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.373256] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.373342] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.373570] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.373570] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.373900] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.374017] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.374122] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.374591] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.374591] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.374591] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.374591] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.375114] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.375114] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.375114] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.376985] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.377221] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.377284] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.377577] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.377678] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.377759] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c264aab4-0245-4fdf-8152-a3476b7dd553 is going to be created. [ 624.453085] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.453269] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.453335] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.453543] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.453902] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.467995] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c264aab4-0245-4fdf-8152-a3476b7dd553 in Status: IN_PROGRESS for 2s [ 625.668590] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16e2d0aa-9161-41ee-99b8-486218dfa51d in Status: SUCCESS [ 625.668891] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16e2d0aa-9161-41ee-99b8-486218dfa51d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.668971] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16e2d0aa-9161-41ee-99b8-486218dfa51d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.669200] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16e2d0aa-9161-41ee-99b8-486218dfa51d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.669395] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.669513] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.669579] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.669723] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.669802] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.669885] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16e2d0aa-9161-41ee-99b8-486218dfa51d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.669972] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('16e2d0aa-9161-41ee-99b8-486218dfa51d',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.172850] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('16e2d0aa-9161-41ee-99b8-486218dfa51d',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.491812] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c264aab4-0245-4fdf-8152-a3476b7dd553 in Status: SUCCESS [ 626.491932] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c264aab4-0245-4fdf-8152-a3476b7dd553" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.676618] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 16e2d0aa-9161-41ee-99b8-486218dfa51d: rpc.has_security_group_logging(os_id): False [ 626.699695] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.699695] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.699695] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.700165] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.700165] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.700369] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.700555] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.700674] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.700895] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.701014] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.701083] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 16e2d0aa-9161-41ee-99b8-486218dfa51d is going to be created. [ 626.777631] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.777883] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.777883] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.778052] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.778232] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.790048] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 16e2d0aa-9161-41ee-99b8-486218dfa51d in Status: IN_PROGRESS for 2s [ 627.102666] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 627.102963] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 627.473514] env[65065]: INFO networking_nsxv3.common.synchronization [None req-c35d9880-19b7-4666-b309-0f1494bf71e9 None None] Enqueued Resource ID: 21b9c6af-2d8d-40ab-a821-774ede42e6fa with Priority: HIGHEST for action port [ 627.474044] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21b9c6af-2d8d-40ab-a821-774ede42e6fa with Priority: HIGHEST for action port [ 627.474358] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-21b9c6af-2d8d-40ab-a821-774ede42e6fa taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.475521] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-21b9c6af-2d8d-40ab-a821-774ede42e6fa" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.475577] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-21b9c6af-2d8d-40ab-a821-774ede42e6fa" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.475862] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-21b9c6af-2d8d-40ab-a821-774ede42e6fa" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.475990] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('21b9c6af-2d8d-40ab-a821-774ede42e6fa',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.979942] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 21b9c6af-2d8d-40ab-a821-774ede42e6fa [ 627.980265] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.980409] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.980493] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.980709] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.980804] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.980897] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:21b9c6af-2d8d-40ab-a821-774ede42e6fa already deleted. [ 627.980979] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-21b9c6af-2d8d-40ab-a821-774ede42e6fa" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.806988] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 16e2d0aa-9161-41ee-99b8-486218dfa51d in Status: SUCCESS [ 628.808591] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-16e2d0aa-9161-41ee-99b8-486218dfa51d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.352924] env[65065]: INFO networking_nsxv3.common.synchronization [None req-fe28e00e-10d6-4ec1-82b8-cca3f7c94de3 None None] Enqueued Resource ID: ab85e9ae-3dad-4bf0-a98c-7d63bb08a7f8 with Priority: HIGHEST for action port [ 629.354031] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab85e9ae-3dad-4bf0-a98c-7d63bb08a7f8 with Priority: HIGHEST for action port [ 629.355097] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-ab85e9ae-3dad-4bf0-a98c-7d63bb08a7f8 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.355097] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ab85e9ae-3dad-4bf0-a98c-7d63bb08a7f8" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.355097] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ab85e9ae-3dad-4bf0-a98c-7d63bb08a7f8" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.355097] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ab85e9ae-3dad-4bf0-a98c-7d63bb08a7f8" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.355097] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ab85e9ae-3dad-4bf0-a98c-7d63bb08a7f8',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.562978] env[65065]: INFO networking_nsxv3.common.synchronization [req-3c8a4fb2-649a-49bb-9a61-56ca5f2be01e req-e7c9072b-2679-4679-8e23-d0694efaa9fc tempest-TenantUsagesTestJSON-1261751082 tempest-TenantUsagesTestJSON-1261751082-project-member] Enqueued Resource ID: 39a21d13-3ed6-45f8-bfde-b892e16df2e1 with Priority: HIGHEST for action security_group_members [ 629.563218] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39a21d13-3ed6-45f8-bfde-b892e16df2e1 with Priority: HIGHEST for action security_group_members [ 629.563364] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-39a21d13-3ed6-45f8-bfde-b892e16df2e1 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.563485] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39a21d13-3ed6-45f8-bfde-b892e16df2e1" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.563550] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39a21d13-3ed6-45f8-bfde-b892e16df2e1" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.563799] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39a21d13-3ed6-45f8-bfde-b892e16df2e1" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.563944] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.564155] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.564245] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.564432] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.564565] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.564676] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('39a21d13-3ed6-45f8-bfde-b892e16df2e1',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.859979] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ab85e9ae-3dad-4bf0-a98c-7d63bb08a7f8 [ 629.860196] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.860337] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.860402] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.860619] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.860703] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.860795] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ab85e9ae-3dad-4bf0-a98c-7d63bb08a7f8 already deleted. [ 629.860874] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ab85e9ae-3dad-4bf0-a98c-7d63bb08a7f8" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.047350] env[65065]: INFO networking_nsxv3.common.synchronization [None req-a34f8d13-38ad-4b7a-ad20-802defd8e539 None None] Enqueued Resource ID: f81f8008-1c06-48ab-8d53-fa3023c8de61 with Priority: HIGHEST for action port [ 630.047899] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f81f8008-1c06-48ab-8d53-fa3023c8de61 with Priority: HIGHEST for action port [ 630.048218] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-f81f8008-1c06-48ab-8d53-fa3023c8de61 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.048341] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f81f8008-1c06-48ab-8d53-fa3023c8de61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.048410] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f81f8008-1c06-48ab-8d53-fa3023c8de61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.048659] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f81f8008-1c06-48ab-8d53-fa3023c8de61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.048749] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f81f8008-1c06-48ab-8d53-fa3023c8de61',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.067210] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.067210] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.067422] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.067595] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.070414] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.070414] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.070414] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.070414] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.070414] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.070414] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.070414] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39a21d13-3ed6-45f8-bfde-b892e16df2e1 already deleted. [ 630.070414] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39a21d13-3ed6-45f8-bfde-b892e16df2e1" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.126405] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock network-11 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.126588] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "network-11" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.126703] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "network-11" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.126958] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "network-11" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.127239] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.127391] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.127511] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.127708] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.127839] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.128111] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 630.129036] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 630.129688] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 630.129688] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 630.129688] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 630.130334] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 630.130334] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 630.156108] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 630.158139] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 630.158139] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 630.158139] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "network-11" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.158139] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock port-7215d8a1-dc61-4f93-ac10-93fc4d7d650d taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.158139] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "port-7215d8a1-dc61-4f93-ac10-93fc4d7d650d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.158139] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "port-7215d8a1-dc61-4f93-ac10-93fc4d7d650d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.158629] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "port-7215d8a1-dc61-4f93-ac10-93fc4d7d650d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.158629] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7215d8a1-dc61-4f93-ac10-93fc4d7d650d',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.556030] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f81f8008-1c06-48ab-8d53-fa3023c8de61 [ 630.556030] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.556030] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.556030] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.556030] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.556030] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.556030] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f81f8008-1c06-48ab-8d53-fa3023c8de61 already deleted. [ 630.557047] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f81f8008-1c06-48ab-8d53-fa3023c8de61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.661436] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.661640] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.662261] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.662261] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.662261] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.662477] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Segment Port 7215d8a1-dc61-4f93-ac10-93fc4d7d650d not found, creating... [ 630.662644] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.662713] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.662823] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.663050] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.663203] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.663683] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.663683] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.663819] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.664479] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.664479] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.664479] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Resource: SegmentPort with ID: 7215d8a1-dc61-4f93-ac10-93fc4d7d650d is going to be created. [ 630.685048] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.685287] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.686041] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.686041] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.686275] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.686503] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "port-7215d8a1-dc61-4f93-ac10-93fc4d7d650d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.484126] env[65065]: INFO networking_nsxv3.common.synchronization [req-3c8a4fb2-649a-49bb-9a61-56ca5f2be01e req-068b4b7a-8abd-45d6-897f-dc8d9160f4d1 service nova] Enqueued Resource ID: 39a21d13-3ed6-45f8-bfde-b892e16df2e1 with Priority: HIGHEST for action security_group_rules [ 631.484321] env[65065]: INFO networking_nsxv3.common.synchronization [req-3c8a4fb2-649a-49bb-9a61-56ca5f2be01e req-068b4b7a-8abd-45d6-897f-dc8d9160f4d1 service nova] Enqueued Resource ID: 39a21d13-3ed6-45f8-bfde-b892e16df2e1 with Priority: HIGHEST for action security_group_members [ 631.484451] env[65065]: INFO networking_nsxv3.common.synchronization [req-3c8a4fb2-649a-49bb-9a61-56ca5f2be01e req-068b4b7a-8abd-45d6-897f-dc8d9160f4d1 service nova] Enqueued Resource ID: 7215d8a1-dc61-4f93-ac10-93fc4d7d650d with Priority: HIGHEST for action port [ 631.484677] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39a21d13-3ed6-45f8-bfde-b892e16df2e1 with Priority: HIGHEST for action security_group_rules [ 631.484799] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39a21d13-3ed6-45f8-bfde-b892e16df2e1 with Priority: HIGHEST for action security_group_members [ 631.484888] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7215d8a1-dc61-4f93-ac10-93fc4d7d650d with Priority: HIGHEST for action port [ 631.485463] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-39a21d13-3ed6-45f8-bfde-b892e16df2e1 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.485580] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-39a21d13-3ed6-45f8-bfde-b892e16df2e1" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.485678] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-39a21d13-3ed6-45f8-bfde-b892e16df2e1" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.485947] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-39a21d13-3ed6-45f8-bfde-b892e16df2e1" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.487797] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('39a21d13-3ed6-45f8-bfde-b892e16df2e1',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.488505] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-39a21d13-3ed6-45f8-bfde-b892e16df2e1 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.489652] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39a21d13-3ed6-45f8-bfde-b892e16df2e1" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.489691] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39a21d13-3ed6-45f8-bfde-b892e16df2e1" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.491910] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39a21d13-3ed6-45f8-bfde-b892e16df2e1" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.491910] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.491910] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.492286] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.492380] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.492467] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.492565] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('39a21d13-3ed6-45f8-bfde-b892e16df2e1',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.493754] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-7215d8a1-dc61-4f93-ac10-93fc4d7d650d taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.493869] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7215d8a1-dc61-4f93-ac10-93fc4d7d650d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.493924] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7215d8a1-dc61-4f93-ac10-93fc4d7d650d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.494105] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7215d8a1-dc61-4f93-ac10-93fc4d7d650d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.494190] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7215d8a1-dc61-4f93-ac10-93fc4d7d650d',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.815775] env[65065]: INFO networking_nsxv3.common.synchronization [None req-0926eb41-7fe8-4b8c-aa83-27b073478b4e None None] Enqueued Resource ID: 9dc6e0ae-0f13-489f-9f06-669e9238ad1e with Priority: HIGHEST for action port [ 631.816086] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9dc6e0ae-0f13-489f-9f06-669e9238ad1e with Priority: HIGHEST for action port [ 631.817203] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-9dc6e0ae-0f13-489f-9f06-669e9238ad1e taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.817203] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9dc6e0ae-0f13-489f-9f06-669e9238ad1e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.817203] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9dc6e0ae-0f13-489f-9f06-669e9238ad1e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.817203] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9dc6e0ae-0f13-489f-9f06-669e9238ad1e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.817452] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9dc6e0ae-0f13-489f-9f06-669e9238ad1e',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.863162] env[65065]: INFO networking_nsxv3.common.synchronization [req-3586d7c7-f876-45c1-a943-de4c0406cd30 req-9fe9eab2-044e-45d3-9f08-eabb322d7ad1 tempest-AttachInterfacesV270Test-1576634480 tempest-AttachInterfacesV270Test-1576634480-project-member] Enqueued Resource ID: 36b0a7bf-c185-47f8-9c6c-88ed66cc1f56 with Priority: HIGHEST for action security_group_members [ 631.863162] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 36b0a7bf-c185-47f8-9c6c-88ed66cc1f56 with Priority: HIGHEST for action security_group_members [ 631.863162] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-36b0a7bf-c185-47f8-9c6c-88ed66cc1f56 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.863162] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-36b0a7bf-c185-47f8-9c6c-88ed66cc1f56" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.863162] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-36b0a7bf-c185-47f8-9c6c-88ed66cc1f56" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.863859] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-36b0a7bf-c185-47f8-9c6c-88ed66cc1f56" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.864274] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.864821] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.865037] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.867089] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.867089] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.867089] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('36b0a7bf-c185-47f8-9c6c-88ed66cc1f56',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.995931] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('39a21d13-3ed6-45f8-bfde-b892e16df2e1',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.996919] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-39a21d13-3ed6-45f8-bfde-b892e16df2e1 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.996919] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39a21d13-3ed6-45f8-bfde-b892e16df2e1" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.997145] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7215d8a1-dc61-4f93-ac10-93fc4d7d650d with status ACTIVE [ 631.997278] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.997430] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.997499] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.997662] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.997751] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.997916] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.998173] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.998314] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.998501] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.998584] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.998886] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.998997] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.999069] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.999232] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.999312] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.999400] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7215d8a1-dc61-4f93-ac10-93fc4d7d650d is going to be updated. [ 632.044601] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.044761] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.044825] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.045650] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.045650] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.045650] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7215d8a1-dc61-4f93-ac10-93fc4d7d650d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.101442] env[65065]: INFO networking_nsxv3.common.synchronization [None req-93d2879f-412a-48a2-81d5-f79ca8582ef6 None None] Enqueued Resource ID: fc59925f-30a9-47c1-87c5-b5a28fb1c6ca with Priority: HIGHEST for action port [ 632.101442] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc59925f-30a9-47c1-87c5-b5a28fb1c6ca with Priority: HIGHEST for action port [ 632.101963] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-fc59925f-30a9-47c1-87c5-b5a28fb1c6ca taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.102073] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fc59925f-30a9-47c1-87c5-b5a28fb1c6ca" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.102129] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fc59925f-30a9-47c1-87c5-b5a28fb1c6ca" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.102437] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fc59925f-30a9-47c1-87c5-b5a28fb1c6ca" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.103102] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fc59925f-30a9-47c1-87c5-b5a28fb1c6ca',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.319882] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9dc6e0ae-0f13-489f-9f06-669e9238ad1e [ 632.319882] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.320103] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.320103] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.320231] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.320400] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.320400] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9dc6e0ae-0f13-489f-9f06-669e9238ad1e already deleted. [ 632.320528] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9dc6e0ae-0f13-489f-9f06-669e9238ad1e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.369062] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.369331] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.369331] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.370027] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.370027] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.370027] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.370027] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.370027] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.370305] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.370305] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.370305] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 36b0a7bf-c185-47f8-9c6c-88ed66cc1f56 is going to be updated. [ 632.406389] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.406389] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.406590] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.407373] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.407373] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.416408] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 36b0a7bf-c185-47f8-9c6c-88ed66cc1f56 in Status: IN_PROGRESS for 2s [ 632.503062] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('39a21d13-3ed6-45f8-bfde-b892e16df2e1',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.546573] env[65065]: INFO networking_nsxv3.common.synchronization [req-27509255-39a1-49a9-b4c9-14747f4066eb req-f7a65cad-d4c1-4724-8bcc-6bebbd1c34bb tempest-ServersAdminNegativeTestJSON-568589506 tempest-ServersAdminNegativeTestJSON-568589506-project-member] Enqueued Resource ID: cc04914d-716e-49e1-8a77-946f904f69bb with Priority: HIGHEST for action security_group_members [ 632.547110] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc04914d-716e-49e1-8a77-946f904f69bb with Priority: HIGHEST for action security_group_members [ 632.547482] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc04914d-716e-49e1-8a77-946f904f69bb taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.547607] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc04914d-716e-49e1-8a77-946f904f69bb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.547672] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc04914d-716e-49e1-8a77-946f904f69bb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.547918] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc04914d-716e-49e1-8a77-946f904f69bb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.548021] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.548605] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.548605] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.548865] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.548996] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.549144] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc04914d-716e-49e1-8a77-946f904f69bb',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.605365] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fc59925f-30a9-47c1-87c5-b5a28fb1c6ca [ 632.605898] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.605898] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.605898] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.606121] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.606121] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.606121] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fc59925f-30a9-47c1-87c5-b5a28fb1c6ca already deleted. [ 632.606211] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fc59925f-30a9-47c1-87c5-b5a28fb1c6ca" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.008606] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.009278] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.009278] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.011335] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.011499] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.012406] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39a21d13-3ed6-45f8-bfde-b892e16df2e1 is going to be created. [ 633.054412] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cc04914d-716e-49e1-8a77-946f904f69bb',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.063209] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.063399] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.063479] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.064051] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.064345] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.078717] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39a21d13-3ed6-45f8-bfde-b892e16df2e1 in Status: UNINITIALIZED for 2s [ 633.467258] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock network-11 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.467493] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "network-11" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.467607] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "network-11" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.469111] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "network-11" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.469274] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.469441] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.469555] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.469798] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.469956] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.470227] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 633.472270] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 633.472270] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 633.472270] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 633.472270] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 633.472270] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 633.472270] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 633.495299] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 633.495299] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 633.495299] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 633.495299] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "network-11" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.496326] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock port-90edae04-8228-4b23-8916-686a34b610c3 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.496889] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "port-90edae04-8228-4b23-8916-686a34b610c3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.497391] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "port-90edae04-8228-4b23-8916-686a34b610c3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.498327] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "port-90edae04-8228-4b23-8916-686a34b610c3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.498684] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('90edae04-8228-4b23-8916-686a34b610c3',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.557555] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cc04914d-716e-49e1-8a77-946f904f69bb',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.671935] env[65065]: INFO networking_nsxv3.common.synchronization [None req-a17708ad-00cf-48f8-972e-efec06eeb81b tempest-ServerActionsTestOtherB-1640131964 tempest-ServerActionsTestOtherB-1640131964-project-member] Enqueued Resource ID: b95b4f27-41f6-4a01-a1aa-aa16348ad807 with Priority: HIGHEST for action security_group_rules [ 633.672499] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b95b4f27-41f6-4a01-a1aa-aa16348ad807 with Priority: HIGHEST for action security_group_rules [ 633.672805] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b95b4f27-41f6-4a01-a1aa-aa16348ad807 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.673142] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b95b4f27-41f6-4a01-a1aa-aa16348ad807" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.673142] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b95b4f27-41f6-4a01-a1aa-aa16348ad807" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.673326] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b95b4f27-41f6-4a01-a1aa-aa16348ad807" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.673397] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b95b4f27-41f6-4a01-a1aa-aa16348ad807',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.002027] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.002388] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.002605] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.003050] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.003309] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.003604] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Segment Port 90edae04-8228-4b23-8916-686a34b610c3 not found, creating... [ 634.003981] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.004257] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.004504] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.004931] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.005125] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.005587] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.005848] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.006070] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.006305] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.006485] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.006672] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Resource: SegmentPort with ID: 90edae04-8228-4b23-8916-686a34b610c3 is going to be created. [ 634.031668] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.032099] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.032099] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.032318] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.032549] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.032770] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "port-90edae04-8228-4b23-8916-686a34b610c3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.051266] env[65065]: INFO networking_nsxv3.common.synchronization [None req-36a30096-f885-4f1e-8131-e2c2d03b6420 tempest-ServerActionsTestOtherB-1640131964 tempest-ServerActionsTestOtherB-1640131964-project-member] Enqueued Resource ID: b95b4f27-41f6-4a01-a1aa-aa16348ad807 with Priority: HIGHEST for action security_group_rules [ 634.051777] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b95b4f27-41f6-4a01-a1aa-aa16348ad807 with Priority: HIGHEST for action security_group_rules [ 634.052085] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b95b4f27-41f6-4a01-a1aa-aa16348ad807 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.052243] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b95b4f27-41f6-4a01-a1aa-aa16348ad807" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.059242] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.059457] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.059678] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.059989] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.060141] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.060286] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc04914d-716e-49e1-8a77-946f904f69bb is going to be updated. [ 634.098656] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.098843] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.098928] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.099155] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.099299] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.119825] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc04914d-716e-49e1-8a77-946f904f69bb in Status: IN_PROGRESS for 2s [ 634.146680] env[65065]: INFO networking_nsxv3.common.synchronization [None req-b6f9f01b-94ff-4bc5-b544-0266dd8b2b9d None None] Enqueued Resource ID: e84ec380-8a9f-4543-9c61-eec1a5c96633 with Priority: HIGHEST for action port [ 634.147018] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e84ec380-8a9f-4543-9c61-eec1a5c96633 with Priority: HIGHEST for action port [ 634.147642] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-e84ec380-8a9f-4543-9c61-eec1a5c96633 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.147970] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e84ec380-8a9f-4543-9c61-eec1a5c96633" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.147970] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e84ec380-8a9f-4543-9c61-eec1a5c96633" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.148252] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e84ec380-8a9f-4543-9c61-eec1a5c96633" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.148357] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e84ec380-8a9f-4543-9c61-eec1a5c96633',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.201661] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.201884] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.201884] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.202137] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.202230] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.202322] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b95b4f27-41f6-4a01-a1aa-aa16348ad807 already deleted. [ 634.202399] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b95b4f27-41f6-4a01-a1aa-aa16348ad807" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.202931] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b95b4f27-41f6-4a01-a1aa-aa16348ad807" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.203147] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b95b4f27-41f6-4a01-a1aa-aa16348ad807" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.203281] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b95b4f27-41f6-4a01-a1aa-aa16348ad807',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.426388] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 36b0a7bf-c185-47f8-9c6c-88ed66cc1f56 in Status: SUCCESS [ 634.426582] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 36b0a7bf-c185-47f8-9c6c-88ed66cc1f56 deletion is rescheduled due to dependency. [ 634.426671] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-36b0a7bf-c185-47f8-9c6c-88ed66cc1f56" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.523577] env[65065]: INFO networking_nsxv3.common.synchronization [req-d24a2a3e-eba3-4073-8cf0-7c3af7004444 req-8debd943-fe82-4c99-8df5-dcf861bd0657 tempest-ListImageFiltersTestJSON-354392293 tempest-ListImageFiltersTestJSON-354392293-project-member] Enqueued Resource ID: 1cb445c1-075d-4f89-884f-a4bbf84030d0 with Priority: HIGHEST for action security_group_members [ 634.524133] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cb445c1-075d-4f89-884f-a4bbf84030d0 with Priority: HIGHEST for action security_group_members [ 634.524433] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-1cb445c1-075d-4f89-884f-a4bbf84030d0 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.524553] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1cb445c1-075d-4f89-884f-a4bbf84030d0" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.524617] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1cb445c1-075d-4f89-884f-a4bbf84030d0" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.524873] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1cb445c1-075d-4f89-884f-a4bbf84030d0" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.525040] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.525198] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.525317] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.525365] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.525454] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.525547] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1cb445c1-075d-4f89-884f-a4bbf84030d0',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.651190] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e84ec380-8a9f-4543-9c61-eec1a5c96633 [ 634.651190] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.651190] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.652658] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.652658] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.652658] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.652658] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e84ec380-8a9f-4543-9c61-eec1a5c96633 already deleted. [ 634.652658] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e84ec380-8a9f-4543-9c61-eec1a5c96633" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.724624] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.725022] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.725022] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.725155] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.725196] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.725305] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b95b4f27-41f6-4a01-a1aa-aa16348ad807 already deleted. [ 634.725392] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b95b4f27-41f6-4a01-a1aa-aa16348ad807" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.761704] env[65065]: INFO networking_nsxv3.common.synchronization [req-27509255-39a1-49a9-b4c9-14747f4066eb req-22588812-d00b-4506-975b-3a2829d98148 service nova] Enqueued Resource ID: cc04914d-716e-49e1-8a77-946f904f69bb with Priority: HIGHEST for action security_group_rules [ 634.761886] env[65065]: INFO networking_nsxv3.common.synchronization [req-27509255-39a1-49a9-b4c9-14747f4066eb req-22588812-d00b-4506-975b-3a2829d98148 service nova] Enqueued Resource ID: cc04914d-716e-49e1-8a77-946f904f69bb with Priority: HIGHEST for action security_group_members [ 634.762042] env[65065]: INFO networking_nsxv3.common.synchronization [req-27509255-39a1-49a9-b4c9-14747f4066eb req-22588812-d00b-4506-975b-3a2829d98148 service nova] Enqueued Resource ID: 90edae04-8228-4b23-8916-686a34b610c3 with Priority: HIGHEST for action port [ 634.762607] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc04914d-716e-49e1-8a77-946f904f69bb with Priority: HIGHEST for action security_group_rules [ 634.762731] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc04914d-716e-49e1-8a77-946f904f69bb with Priority: HIGHEST for action security_group_members [ 634.762851] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90edae04-8228-4b23-8916-686a34b610c3 with Priority: HIGHEST for action port [ 634.764730] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cc04914d-716e-49e1-8a77-946f904f69bb taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.764893] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cc04914d-716e-49e1-8a77-946f904f69bb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.765343] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cc04914d-716e-49e1-8a77-946f904f69bb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.765343] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cc04914d-716e-49e1-8a77-946f904f69bb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.765343] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cc04914d-716e-49e1-8a77-946f904f69bb',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.766807] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc04914d-716e-49e1-8a77-946f904f69bb taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.766923] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc04914d-716e-49e1-8a77-946f904f69bb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.768196] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-90edae04-8228-4b23-8916-686a34b610c3 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.768308] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-90edae04-8228-4b23-8916-686a34b610c3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.768350] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-90edae04-8228-4b23-8916-686a34b610c3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.768910] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-90edae04-8228-4b23-8916-686a34b610c3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.768910] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('90edae04-8228-4b23-8916-686a34b610c3',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.029704] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.029704] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.029704] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.029704] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.029704] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.029704] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.029704] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.029704] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.029704] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.029704] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.030081] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1cb445c1-075d-4f89-884f-a4bbf84030d0 already deleted. [ 635.030081] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1cb445c1-075d-4f89-884f-a4bbf84030d0" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.090164] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39a21d13-3ed6-45f8-bfde-b892e16df2e1 in Status: SUCCESS [ 635.090164] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39a21d13-3ed6-45f8-bfde-b892e16df2e1" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.090164] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39a21d13-3ed6-45f8-bfde-b892e16df2e1" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.090164] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39a21d13-3ed6-45f8-bfde-b892e16df2e1" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.090164] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.090164] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.090164] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.090903] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.090903] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.090903] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39a21d13-3ed6-45f8-bfde-b892e16df2e1" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.090903] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('39a21d13-3ed6-45f8-bfde-b892e16df2e1',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.224671] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock network-11 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.224853] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "network-11" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.225017] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "network-11" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.225336] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "network-11" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.225579] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.225729] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.225840] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.226063] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.226203] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.226402] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 635.226506] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 635.226610] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 635.226713] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 635.226815] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 635.226914] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 635.227045] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 635.249257] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 635.249428] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 635.249561] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 635.249732] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "network-11" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.250057] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock port-934ebe07-f80b-4340-b307-20184a6fa333 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.250351] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "port-934ebe07-f80b-4340-b307-20184a6fa333" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.250425] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "port-934ebe07-f80b-4340-b307-20184a6fa333" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.250802] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "port-934ebe07-f80b-4340-b307-20184a6fa333" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.251193] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('934ebe07-f80b-4340-b307-20184a6fa333',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.270658] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc04914d-716e-49e1-8a77-946f904f69bb taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.270658] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc04914d-716e-49e1-8a77-946f904f69bb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.270859] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 90edae04-8228-4b23-8916-686a34b610c3 with status ACTIVE [ 635.271121] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.271279] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.271387] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.271908] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.271908] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.271977] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.272116] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.272149] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.272298] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.272379] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.272560] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.272652] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.273548] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.273548] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.273548] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.275781] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 90edae04-8228-4b23-8916-686a34b610c3 is going to be updated. [ 635.297603] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.297603] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.297603] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.297780] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.297815] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.298389] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-90edae04-8228-4b23-8916-686a34b610c3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.498618] env[65065]: INFO networking_nsxv3.common.synchronization [req-419264fa-ab94-4d98-86af-c58fc95c59ad req-7a35acae-0af3-4471-adca-90816a25754e tempest-VolumesAdminNegativeTest-733073170 tempest-VolumesAdminNegativeTest-733073170-project-member] Enqueued Resource ID: 8a13ba64-a593-4798-b668-78791377ba50 with Priority: HIGHEST for action security_group_members [ 635.499081] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a13ba64-a593-4798-b668-78791377ba50 with Priority: HIGHEST for action security_group_members [ 635.499755] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a13ba64-a593-4798-b668-78791377ba50 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.499924] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a13ba64-a593-4798-b668-78791377ba50" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.500038] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a13ba64-a593-4798-b668-78791377ba50" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.500261] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a13ba64-a593-4798-b668-78791377ba50" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.500426] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.500527] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.500580] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.500726] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.500810] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.500900] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8a13ba64-a593-4798-b668-78791377ba50',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.597717] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-39a21d13-3ed6-45f8-bfde-b892e16df2e1 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.597875] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39a21d13-3ed6-45f8-bfde-b892e16df2e1" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.597938] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39a21d13-3ed6-45f8-bfde-b892e16df2e1" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.598200] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39a21d13-3ed6-45f8-bfde-b892e16df2e1" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.598380] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.598536] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.598642] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.598910] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.599075] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.599232] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39a21d13-3ed6-45f8-bfde-b892e16df2e1" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.599605] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-39a21d13-3ed6-45f8-bfde-b892e16df2e1 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.599767] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39a21d13-3ed6-45f8-bfde-b892e16df2e1" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.599887] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39a21d13-3ed6-45f8-bfde-b892e16df2e1" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.600140] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39a21d13-3ed6-45f8-bfde-b892e16df2e1" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.600372] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.600534] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.600644] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.600881] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.601125] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.601293] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39a21d13-3ed6-45f8-bfde-b892e16df2e1" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.601402] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('39a21d13-3ed6-45f8-bfde-b892e16df2e1',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.754239] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.754494] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.754557] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.754835] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.754981] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.755146] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Segment Port 934ebe07-f80b-4340-b307-20184a6fa333 not found, creating... [ 635.755783] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.755974] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.756109] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.756333] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.756471] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.756779] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.756946] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.757100] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.757356] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.757498] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.757638] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Resource: SegmentPort with ID: 934ebe07-f80b-4340-b307-20184a6fa333 is going to be created. [ 635.779060] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.779060] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.779060] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.779458] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.779546] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.779766] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "port-934ebe07-f80b-4340-b307-20184a6fa333" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.003686] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.003870] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.004028] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.004185] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.004300] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.004516] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.004619] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.004696] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.004887] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.004970] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.005034] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a13ba64-a593-4798-b668-78791377ba50 is going to be updated. [ 636.035624] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.035858] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.035858] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.037071] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.037071] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.047094] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a13ba64-a593-4798-b668-78791377ba50 in Status: IN_PROGRESS for 2s [ 636.104020] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 39a21d13-3ed6-45f8-bfde-b892e16df2e1: rpc.has_security_group_logging(os_id): False [ 636.132702] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc04914d-716e-49e1-8a77-946f904f69bb in Status: SUCCESS [ 636.133109] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc04914d-716e-49e1-8a77-946f904f69bb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.133433] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc04914d-716e-49e1-8a77-946f904f69bb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.134211] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc04914d-716e-49e1-8a77-946f904f69bb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.134211] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.134377] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.134438] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.134715] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.134831] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.134942] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc04914d-716e-49e1-8a77-946f904f69bb',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.138801] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.138801] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.138801] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.139276] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.139276] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.139276] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.139403] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.139438] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.139722] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.139828] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.140103] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.140220] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.140487] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.140487] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.140568] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.140768] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.140863] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.140931] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.141185] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.141185] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.141308] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 39a21d13-3ed6-45f8-bfde-b892e16df2e1 is going to be created. [ 636.203572] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.203756] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.203861] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.204043] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.204239] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.216490] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 39a21d13-3ed6-45f8-bfde-b892e16df2e1 in Status: IN_PROGRESS for 2s [ 636.524557] env[65065]: INFO networking_nsxv3.common.synchronization [req-953ac31a-c24e-4e0c-8216-9e8da54dc28d req-612ac59d-bc12-44dd-856f-e334e25b7840 tempest-ImagesTestJSON-1714479415 tempest-ImagesTestJSON-1714479415-project-member] Enqueued Resource ID: e6d7baac-4bff-46b9-b88d-2dc982621c0f with Priority: HIGHEST for action security_group_members [ 636.525173] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6d7baac-4bff-46b9-b88d-2dc982621c0f with Priority: HIGHEST for action security_group_members [ 636.525519] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6d7baac-4bff-46b9-b88d-2dc982621c0f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.525606] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.525661] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.526129] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.526281] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.526406] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.526471] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.526646] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.526719] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.526812] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e6d7baac-4bff-46b9-b88d-2dc982621c0f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.536320] env[65065]: INFO networking_nsxv3.common.synchronization [req-d24a2a3e-eba3-4073-8cf0-7c3af7004444 req-91055bac-ca59-4265-b75b-9066716e14c2 service nova] Enqueued Resource ID: 1cb445c1-075d-4f89-884f-a4bbf84030d0 with Priority: HIGHEST for action security_group_rules [ 636.536522] env[65065]: INFO networking_nsxv3.common.synchronization [req-d24a2a3e-eba3-4073-8cf0-7c3af7004444 req-91055bac-ca59-4265-b75b-9066716e14c2 service nova] Enqueued Resource ID: 1cb445c1-075d-4f89-884f-a4bbf84030d0 with Priority: HIGHEST for action security_group_members [ 636.536604] env[65065]: INFO networking_nsxv3.common.synchronization [req-d24a2a3e-eba3-4073-8cf0-7c3af7004444 req-91055bac-ca59-4265-b75b-9066716e14c2 service nova] Enqueued Resource ID: 934ebe07-f80b-4340-b307-20184a6fa333 with Priority: HIGHEST for action port [ 636.540016] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cb445c1-075d-4f89-884f-a4bbf84030d0 with Priority: HIGHEST for action security_group_rules [ 636.540016] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cb445c1-075d-4f89-884f-a4bbf84030d0 with Priority: HIGHEST for action security_group_members [ 636.540016] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 934ebe07-f80b-4340-b307-20184a6fa333 with Priority: HIGHEST for action port [ 636.540016] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1cb445c1-075d-4f89-884f-a4bbf84030d0 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.540016] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1cb445c1-075d-4f89-884f-a4bbf84030d0" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.540016] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1cb445c1-075d-4f89-884f-a4bbf84030d0" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.540016] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1cb445c1-075d-4f89-884f-a4bbf84030d0" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.540016] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1cb445c1-075d-4f89-884f-a4bbf84030d0',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.540016] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-1cb445c1-075d-4f89-884f-a4bbf84030d0 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.540016] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1cb445c1-075d-4f89-884f-a4bbf84030d0" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.540016] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1cb445c1-075d-4f89-884f-a4bbf84030d0" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.540016] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1cb445c1-075d-4f89-884f-a4bbf84030d0" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.540016] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.540016] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.540016] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.540870] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.540870] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.540870] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1cb445c1-075d-4f89-884f-a4bbf84030d0',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.542512] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-934ebe07-f80b-4340-b307-20184a6fa333 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.542641] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-934ebe07-f80b-4340-b307-20184a6fa333" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.542744] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-934ebe07-f80b-4340-b307-20184a6fa333" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.542822] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-934ebe07-f80b-4340-b307-20184a6fa333" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.542961] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('934ebe07-f80b-4340-b307-20184a6fa333',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.645887] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cc04914d-716e-49e1-8a77-946f904f69bb',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.913815] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock network-582 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.914017] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "network-582" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.914143] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "network-582" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.914485] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "network-582" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.914743] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.914894] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.915010] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.915257] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.915401] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.915592] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 636.915696] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 636.915795] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 636.915896] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 636.915996] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 636.916110] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 636.916313] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 636.935936] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 636.935936] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 636.935936] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 636.935936] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "network-582" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.936324] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock port-da795abc-f151-4d88-806a-be9ade6330fc taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.936443] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "port-da795abc-f151-4d88-806a-be9ade6330fc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.936535] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "port-da795abc-f151-4d88-806a-be9ade6330fc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.936848] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "port-da795abc-f151-4d88-806a-be9ade6330fc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.936980] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('da795abc-f151-4d88-806a-be9ade6330fc',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.029624] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.029834] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.029889] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.030128] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.030258] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.030549] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.030703] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.030792] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.031042] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.031428] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.031586] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6d7baac-4bff-46b9-b88d-2dc982621c0f already deleted. [ 637.031723] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.044457] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-1cb445c1-075d-4f89-884f-a4bbf84030d0 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.044935] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1cb445c1-075d-4f89-884f-a4bbf84030d0" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.046327] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1cb445c1-075d-4f89-884f-a4bbf84030d0',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.047444] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 934ebe07-f80b-4340-b307-20184a6fa333 with status ACTIVE [ 637.047630] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.047764] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.047831] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.048084] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.049082] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.049082] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.049082] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.049082] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.049082] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.049082] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.049082] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.049082] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.049082] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.049456] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.049456] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.049542] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 934ebe07-f80b-4340-b307-20184a6fa333 is going to be updated. [ 637.082322] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.082322] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.082322] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.082764] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.082764] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.082764] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-934ebe07-f80b-4340-b307-20184a6fa333" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.152549] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cc04914d-716e-49e1-8a77-946f904f69bb',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.439911] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.440219] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.440419] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.441224] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.441224] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.441224] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Segment Port da795abc-f151-4d88-806a-be9ade6330fc not found, creating... [ 637.441379] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.441443] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.441551] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.442228] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.442458] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.442784] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.443307] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.443465] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.443802] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.444030] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.444336] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Resource: SegmentPort with ID: da795abc-f151-4d88-806a-be9ade6330fc is going to be created. [ 637.466939] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.467196] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.467355] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.467628] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.467851] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.468115] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "port-da795abc-f151-4d88-806a-be9ade6330fc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.551415] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1cb445c1-075d-4f89-884f-a4bbf84030d0',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.655517] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.655724] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.655808] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.655963] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.656238] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.656238] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc04914d-716e-49e1-8a77-946f904f69bb is going to be updated. [ 637.688935] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.689098] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.689340] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.689651] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.689788] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.699652] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc04914d-716e-49e1-8a77-946f904f69bb in Status: IN_PROGRESS for 2s [ 637.922788] env[65065]: INFO networking_nsxv3.common.synchronization [None req-c5cdffc4-3d22-40d3-b27b-7f25b4c6a0d4 None None] Enqueued Resource ID: deed2aa6-d000-42fa-8540-6818ad959c96 with Priority: HIGHEST for action port [ 637.923143] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: deed2aa6-d000-42fa-8540-6818ad959c96 with Priority: HIGHEST for action port [ 637.923465] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-deed2aa6-d000-42fa-8540-6818ad959c96 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.923588] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-deed2aa6-d000-42fa-8540-6818ad959c96" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.923648] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-deed2aa6-d000-42fa-8540-6818ad959c96" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.924426] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-deed2aa6-d000-42fa-8540-6818ad959c96" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.924426] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('deed2aa6-d000-42fa-8540-6818ad959c96',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.056540] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.056540] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.056540] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.056540] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.056540] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.056540] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1cb445c1-075d-4f89-884f-a4bbf84030d0 is going to be created. [ 638.058303] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a13ba64-a593-4798-b668-78791377ba50 in Status: SUCCESS [ 638.059402] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a13ba64-a593-4798-b668-78791377ba50 deletion is rescheduled due to dependency. [ 638.059750] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a13ba64-a593-4798-b668-78791377ba50" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.089236] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.089369] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.089432] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.089823] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.089823] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.101821] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1cb445c1-075d-4f89-884f-a4bbf84030d0 in Status: UNINITIALIZED for 2s [ 638.195967] env[65065]: INFO networking_nsxv3.common.synchronization [req-953ac31a-c24e-4e0c-8216-9e8da54dc28d req-4b4570ab-36fb-4f60-8c2a-3623cd216b41 service nova] Enqueued Resource ID: e6d7baac-4bff-46b9-b88d-2dc982621c0f with Priority: HIGHEST for action security_group_rules [ 638.196251] env[65065]: INFO networking_nsxv3.common.synchronization [req-953ac31a-c24e-4e0c-8216-9e8da54dc28d req-4b4570ab-36fb-4f60-8c2a-3623cd216b41 service nova] Enqueued Resource ID: e6d7baac-4bff-46b9-b88d-2dc982621c0f with Priority: HIGHEST for action security_group_members [ 638.196294] env[65065]: INFO networking_nsxv3.common.synchronization [req-953ac31a-c24e-4e0c-8216-9e8da54dc28d req-4b4570ab-36fb-4f60-8c2a-3623cd216b41 service nova] Enqueued Resource ID: da795abc-f151-4d88-806a-be9ade6330fc with Priority: HIGHEST for action port [ 638.196810] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6d7baac-4bff-46b9-b88d-2dc982621c0f with Priority: HIGHEST for action security_group_rules [ 638.196993] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6d7baac-4bff-46b9-b88d-2dc982621c0f with Priority: HIGHEST for action security_group_members [ 638.197106] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da795abc-f151-4d88-806a-be9ade6330fc with Priority: HIGHEST for action port [ 638.197442] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e6d7baac-4bff-46b9-b88d-2dc982621c0f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.197568] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.197636] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.197891] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.197980] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e6d7baac-4bff-46b9-b88d-2dc982621c0f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.198979] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6d7baac-4bff-46b9-b88d-2dc982621c0f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.199109] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.199176] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.199337] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.199482] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.199574] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.199652] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.199792] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.199873] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.199979] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e6d7baac-4bff-46b9-b88d-2dc982621c0f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.200730] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-da795abc-f151-4d88-806a-be9ade6330fc taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.200835] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-da795abc-f151-4d88-806a-be9ade6330fc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.200902] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-da795abc-f151-4d88-806a-be9ade6330fc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.201061] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-da795abc-f151-4d88-806a-be9ade6330fc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.201152] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('da795abc-f151-4d88-806a-be9ade6330fc',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.228467] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 39a21d13-3ed6-45f8-bfde-b892e16df2e1 in Status: SUCCESS [ 638.228768] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-39a21d13-3ed6-45f8-bfde-b892e16df2e1" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.423708] env[65065]: INFO networking_nsxv3.common.synchronization [None req-5d50c7db-9dd5-4b94-b084-6538cbf3d6f6 tempest-ServerActionsTestJSON-1279756280 tempest-ServerActionsTestJSON-1279756280-project-member] Enqueued Resource ID: c587345b-51c8-42f7-8a0c-052027c4b18c with Priority: HIGHEST for action security_group_rules [ 638.425287] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c587345b-51c8-42f7-8a0c-052027c4b18c with Priority: HIGHEST for action security_group_rules [ 638.425752] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port deed2aa6-d000-42fa-8540-6818ad959c96 [ 638.426123] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.426833] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.426833] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.426988] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.427535] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.427535] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:deed2aa6-d000-42fa-8540-6818ad959c96 already deleted. [ 638.427535] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-deed2aa6-d000-42fa-8540-6818ad959c96" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.428322] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c587345b-51c8-42f7-8a0c-052027c4b18c taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.428322] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c587345b-51c8-42f7-8a0c-052027c4b18c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.428322] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c587345b-51c8-42f7-8a0c-052027c4b18c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.428965] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c587345b-51c8-42f7-8a0c-052027c4b18c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.430073] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c587345b-51c8-42f7-8a0c-052027c4b18c',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.625609] env[65065]: INFO networking_nsxv3.common.synchronization [None req-5602b88f-b54e-44f6-b121-72c53856e558 tempest-ServerActionsTestJSON-1279756280 tempest-ServerActionsTestJSON-1279756280-project-member] Enqueued Resource ID: c587345b-51c8-42f7-8a0c-052027c4b18c with Priority: HIGHEST for action security_group_rules [ 638.626676] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c587345b-51c8-42f7-8a0c-052027c4b18c with Priority: HIGHEST for action security_group_rules [ 638.626676] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c587345b-51c8-42f7-8a0c-052027c4b18c taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.626676] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c587345b-51c8-42f7-8a0c-052027c4b18c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.704883] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e6d7baac-4bff-46b9-b88d-2dc982621c0f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.708124] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6d7baac-4bff-46b9-b88d-2dc982621c0f taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.708124] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.708124] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port da795abc-f151-4d88-806a-be9ade6330fc with status ACTIVE [ 638.708124] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.708124] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.708124] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.708124] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.708124] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.708124] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.708124] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.712113] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.712113] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.712113] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.712451] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.712540] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.712580] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.712827] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.712901] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.712996] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: da795abc-f151-4d88-806a-be9ade6330fc is going to be updated. [ 638.735777] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.735777] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.735998] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.736056] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.737159] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.737159] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-da795abc-f151-4d88-806a-be9ade6330fc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.923841] env[65065]: INFO networking_nsxv3.common.synchronization [req-99fdc068-0449-46e1-8b50-6cd262f5b265 req-31ad009c-12b6-48d6-9fa2-319988826ec4 tempest-ListImageFiltersTestJSON-354392293 tempest-ListImageFiltersTestJSON-354392293-project-member] Enqueued Resource ID: 1cb445c1-075d-4f89-884f-a4bbf84030d0 with Priority: HIGHEST for action security_group_members [ 638.923841] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cb445c1-075d-4f89-884f-a4bbf84030d0 with Priority: HIGHEST for action security_group_members [ 638.923841] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-1cb445c1-075d-4f89-884f-a4bbf84030d0 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.923991] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1cb445c1-075d-4f89-884f-a4bbf84030d0" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.950597] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.950816] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.950859] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.953782] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.953782] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.953782] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c587345b-51c8-42f7-8a0c-052027c4b18c already deleted. [ 638.953782] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c587345b-51c8-42f7-8a0c-052027c4b18c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.953782] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c587345b-51c8-42f7-8a0c-052027c4b18c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.953782] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c587345b-51c8-42f7-8a0c-052027c4b18c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.953782] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c587345b-51c8-42f7-8a0c-052027c4b18c',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.215018] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e6d7baac-4bff-46b9-b88d-2dc982621c0f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.475270] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.475563] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.475637] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.475865] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.476039] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.476162] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c587345b-51c8-42f7-8a0c-052027c4b18c already deleted. [ 639.476309] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c587345b-51c8-42f7-8a0c-052027c4b18c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.552977] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock network-11 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.553242] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "network-11" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.553333] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "network-11" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.553837] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "network-11" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.554143] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.554336] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.554486] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.554677] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.554838] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.555085] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 639.555377] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 639.555377] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 639.555547] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 639.555547] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 639.555666] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 639.555791] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 639.576498] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 639.576705] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 639.576825] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 639.576962] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "network-11" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.577328] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock port-ce699c95-3087-4a44-8841-65364c8c23ec taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.577554] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "port-ce699c95-3087-4a44-8841-65364c8c23ec" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.577673] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "port-ce699c95-3087-4a44-8841-65364c8c23ec" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.577973] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "port-ce699c95-3087-4a44-8841-65364c8c23ec" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.578141] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ce699c95-3087-4a44-8841-65364c8c23ec',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.714672] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc04914d-716e-49e1-8a77-946f904f69bb in Status: SUCCESS [ 639.714672] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc04914d-716e-49e1-8a77-946f904f69bb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.714672] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc04914d-716e-49e1-8a77-946f904f69bb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.715466] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc04914d-716e-49e1-8a77-946f904f69bb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.715466] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.715466] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.715466] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.715694] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.715694] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.715694] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc04914d-716e-49e1-8a77-946f904f69bb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.715892] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cc04914d-716e-49e1-8a77-946f904f69bb',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.717577] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.717681] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.717723] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.717892] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.717984] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.718127] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6d7baac-4bff-46b9-b88d-2dc982621c0f is going to be created. [ 639.762723] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.762875] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.762952] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.763208] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.763380] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.773978] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6d7baac-4bff-46b9-b88d-2dc982621c0f in Status: UNINITIALIZED for 2s [ 639.923479] env[65065]: INFO networking_nsxv3.common.synchronization [req-98279b81-22f8-4dab-9dac-9899c75285a6 req-c18d1772-c63e-41b0-b328-190c33419b69 tempest-SecurityGroupRulesNegativeTestJSON-722195855 tempest-SecurityGroupRulesNegativeTestJSON-722195855-project-member] Enqueued Resource ID: 47b1df8e-a0e7-4e08-86e1-7802829e32e3 with Priority: HIGHEST for action security_group_rules [ 639.924084] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47b1df8e-a0e7-4e08-86e1-7802829e32e3 with Priority: HIGHEST for action security_group_rules [ 639.924412] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-47b1df8e-a0e7-4e08-86e1-7802829e32e3 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.924533] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-47b1df8e-a0e7-4e08-86e1-7802829e32e3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.924595] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-47b1df8e-a0e7-4e08-86e1-7802829e32e3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.924935] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-47b1df8e-a0e7-4e08-86e1-7802829e32e3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.924975] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('47b1df8e-a0e7-4e08-86e1-7802829e32e3',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.081408] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.081729] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.081813] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.082056] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.082204] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.082789] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Segment Port ce699c95-3087-4a44-8841-65364c8c23ec not found, creating... [ 640.082789] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.082978] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.082978] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.086547] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.086547] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.086547] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.086547] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.086547] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.086547] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.086547] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.086547] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Resource: SegmentPort with ID: ce699c95-3087-4a44-8841-65364c8c23ec is going to be created. [ 640.106828] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.107183] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.107414] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.107767] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.108059] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.108308] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "port-ce699c95-3087-4a44-8841-65364c8c23ec" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.113966] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1cb445c1-075d-4f89-884f-a4bbf84030d0 in Status: SUCCESS [ 640.113966] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1cb445c1-075d-4f89-884f-a4bbf84030d0" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.114067] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1cb445c1-075d-4f89-884f-a4bbf84030d0" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.114277] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1cb445c1-075d-4f89-884f-a4bbf84030d0" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.114466] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.114579] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.114642] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.114790] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.114871] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.115032] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1cb445c1-075d-4f89-884f-a4bbf84030d0" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.115092] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1cb445c1-075d-4f89-884f-a4bbf84030d0',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.115928] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1cb445c1-075d-4f89-884f-a4bbf84030d0" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.116160] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1cb445c1-075d-4f89-884f-a4bbf84030d0" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.116353] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.116471] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.116536] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.116681] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.116758] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.116845] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1cb445c1-075d-4f89-884f-a4bbf84030d0',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.220219] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc04914d-716e-49e1-8a77-946f904f69bb taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.220550] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc04914d-716e-49e1-8a77-946f904f69bb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.220550] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc04914d-716e-49e1-8a77-946f904f69bb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.220907] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc04914d-716e-49e1-8a77-946f904f69bb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.220907] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.221157] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.221157] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.221242] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.221242] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.221501] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc04914d-716e-49e1-8a77-946f904f69bb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.221501] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc04914d-716e-49e1-8a77-946f904f69bb taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.221606] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc04914d-716e-49e1-8a77-946f904f69bb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.221606] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc04914d-716e-49e1-8a77-946f904f69bb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.221769] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc04914d-716e-49e1-8a77-946f904f69bb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.222357] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.222357] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.222357] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.222357] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.222357] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.222357] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc04914d-716e-49e1-8a77-946f904f69bb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.222581] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cc04914d-716e-49e1-8a77-946f904f69bb',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.450052] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.450306] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.450391] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.450611] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.450796] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.450836] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 47b1df8e-a0e7-4e08-86e1-7802829e32e3 already deleted. [ 640.450933] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-47b1df8e-a0e7-4e08-86e1-7802829e32e3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.620209] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-1cb445c1-075d-4f89-884f-a4bbf84030d0 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.620209] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1cb445c1-075d-4f89-884f-a4bbf84030d0" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.622614] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1cb445c1-075d-4f89-884f-a4bbf84030d0',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.724487] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cc04914d-716e-49e1-8a77-946f904f69bb: rpc.has_security_group_logging(os_id): False [ 640.746276] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.746586] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.746586] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.746778] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.746778] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.746986] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.747121] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.747219] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.747393] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.747495] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.747721] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.747821] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.747871] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.748287] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.748398] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.748602] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.748693] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.748760] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.750729] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.750729] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.750729] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cc04914d-716e-49e1-8a77-946f904f69bb is going to be updated. [ 640.814849] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.815023] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.815097] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.816050] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.816050] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.833121] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cc04914d-716e-49e1-8a77-946f904f69bb in Status: IN_PROGRESS for 2s [ 640.848100] env[65065]: INFO networking_nsxv3.common.synchronization [req-99fdc068-0449-46e1-8b50-6cd262f5b265 req-c42ebf7a-f4f8-4686-9b64-71c85d680b81 service nova] Enqueued Resource ID: 1cb445c1-075d-4f89-884f-a4bbf84030d0 with Priority: HIGHEST for action security_group_rules [ 640.848327] env[65065]: INFO networking_nsxv3.common.synchronization [req-99fdc068-0449-46e1-8b50-6cd262f5b265 req-c42ebf7a-f4f8-4686-9b64-71c85d680b81 service nova] Enqueued Resource ID: 1cb445c1-075d-4f89-884f-a4bbf84030d0 with Priority: HIGHEST for action security_group_members [ 640.848475] env[65065]: INFO networking_nsxv3.common.synchronization [req-99fdc068-0449-46e1-8b50-6cd262f5b265 req-c42ebf7a-f4f8-4686-9b64-71c85d680b81 service nova] Enqueued Resource ID: ce699c95-3087-4a44-8841-65364c8c23ec with Priority: HIGHEST for action port [ 640.849095] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cb445c1-075d-4f89-884f-a4bbf84030d0 with Priority: HIGHEST for action security_group_rules [ 640.849150] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cb445c1-075d-4f89-884f-a4bbf84030d0 with Priority: HIGHEST for action security_group_members [ 640.849245] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce699c95-3087-4a44-8841-65364c8c23ec with Priority: HIGHEST for action port [ 640.849505] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1cb445c1-075d-4f89-884f-a4bbf84030d0 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.849597] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1cb445c1-075d-4f89-884f-a4bbf84030d0" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.849777] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-1cb445c1-075d-4f89-884f-a4bbf84030d0 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.849850] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1cb445c1-075d-4f89-884f-a4bbf84030d0" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.854112] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-ce699c95-3087-4a44-8841-65364c8c23ec taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.854214] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ce699c95-3087-4a44-8841-65364c8c23ec" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.854847] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ce699c95-3087-4a44-8841-65364c8c23ec" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.854847] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ce699c95-3087-4a44-8841-65364c8c23ec" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.854847] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ce699c95-3087-4a44-8841-65364c8c23ec',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.125083] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1cb445c1-075d-4f89-884f-a4bbf84030d0',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.162027] env[65065]: INFO networking_nsxv3.common.synchronization [None req-35cf9c1c-abac-46ab-9c7a-aaa3bfa3cfd5 None None] Enqueued Resource ID: 28a535fb-0706-434a-acb2-4d56ab52d23d with Priority: HIGHEST for action port [ 641.162767] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28a535fb-0706-434a-acb2-4d56ab52d23d with Priority: HIGHEST for action port [ 641.163131] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-28a535fb-0706-434a-acb2-4d56ab52d23d taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.163274] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-28a535fb-0706-434a-acb2-4d56ab52d23d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.163321] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-28a535fb-0706-434a-acb2-4d56ab52d23d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.163911] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-28a535fb-0706-434a-acb2-4d56ab52d23d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.164030] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('28a535fb-0706-434a-acb2-4d56ab52d23d',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.315833] env[65065]: INFO networking_nsxv3.common.synchronization [req-66641d21-232e-4b06-b768-2685fdf52f99 req-d1766885-a7d7-4755-aba1-123ee6b50b82 tempest-ServersWithSpecificFlavorTestJSON-1007896152 tempest-ServersWithSpecificFlavorTestJSON-1007896152-project-member] Enqueued Resource ID: 9576b45f-b344-47bd-8f8b-9df4c3725ddb with Priority: HIGHEST for action security_group_members [ 641.316741] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9576b45f-b344-47bd-8f8b-9df4c3725ddb with Priority: HIGHEST for action security_group_members [ 641.320374] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-9576b45f-b344-47bd-8f8b-9df4c3725ddb taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.320374] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9576b45f-b344-47bd-8f8b-9df4c3725ddb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.320374] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9576b45f-b344-47bd-8f8b-9df4c3725ddb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.320374] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9576b45f-b344-47bd-8f8b-9df4c3725ddb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.320374] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.320374] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.320374] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.320374] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.320374] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.320374] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9576b45f-b344-47bd-8f8b-9df4c3725ddb',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.356908] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ce699c95-3087-4a44-8841-65364c8c23ec with status ACTIVE [ 641.357259] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.357928] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.358617] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.358617] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.358617] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.358915] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.360355] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.360524] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.360760] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.360873] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.361133] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.361269] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.361351] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.361538] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.362252] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.362252] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ce699c95-3087-4a44-8841-65364c8c23ec is going to be updated. [ 641.389000] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.389184] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.389227] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.389595] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.389595] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.389744] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ce699c95-3087-4a44-8841-65364c8c23ec" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.626947] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.627911] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.627911] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.628101] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.628245] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.628296] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1cb445c1-075d-4f89-884f-a4bbf84030d0 is going to be updated. [ 641.666119] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.666334] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.666395] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.666591] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.666737] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.667990] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 28a535fb-0706-434a-acb2-4d56ab52d23d [ 641.668698] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.668698] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.668698] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.668698] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.668698] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.668963] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:28a535fb-0706-434a-acb2-4d56ab52d23d already deleted. [ 641.668963] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-28a535fb-0706-434a-acb2-4d56ab52d23d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.679262] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1cb445c1-075d-4f89-884f-a4bbf84030d0 in Status: IN_PROGRESS for 2s [ 641.751045] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock network-487 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.751045] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "network-487" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.751045] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "network-487" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.751045] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "network-487" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.751375] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.751375] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.751501] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.751704] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.751841] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.752058] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 641.752166] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 641.752268] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 641.752403] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 641.752540] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 641.752603] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 641.752800] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 641.783159] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 641.783351] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 641.783476] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 641.783627] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "network-487" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.784038] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock port-e2eba435-515c-488d-b3bf-804164b2fef0 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.784220] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "port-e2eba435-515c-488d-b3bf-804164b2fef0" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.784335] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "port-e2eba435-515c-488d-b3bf-804164b2fef0" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.784654] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "port-e2eba435-515c-488d-b3bf-804164b2fef0" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.784791] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e2eba435-515c-488d-b3bf-804164b2fef0',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.786284] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6d7baac-4bff-46b9-b88d-2dc982621c0f in Status: SUCCESS [ 641.786473] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.786938] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.787142] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.787316] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.787428] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.787493] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.787639] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.787797] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.787797] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.787879] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e6d7baac-4bff-46b9-b88d-2dc982621c0f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.822098] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.822347] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.822511] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.822857] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.822999] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.823349] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.823610] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.823610] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.823817] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.824233] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.824233] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9576b45f-b344-47bd-8f8b-9df4c3725ddb already deleted. [ 641.824233] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9576b45f-b344-47bd-8f8b-9df4c3725ddb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.290303] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.292882] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.292882] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.292882] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.292882] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.292882] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Segment Port e2eba435-515c-488d-b3bf-804164b2fef0 not found, creating... [ 642.292882] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.292882] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.292882] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.292882] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.292882] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.293838] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.294053] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.294181] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.294435] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.294617] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.294773] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Resource: SegmentPort with ID: e2eba435-515c-488d-b3bf-804164b2fef0 is going to be created. [ 642.298078] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6d7baac-4bff-46b9-b88d-2dc982621c0f taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.299216] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.299298] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.299660] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.299879] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.299990] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.300101] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.300262] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.300335] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.300424] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.300604] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6d7baac-4bff-46b9-b88d-2dc982621c0f taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.300698] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.300778] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.300937] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.301117] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.301211] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.301274] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.301732] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.301732] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.301732] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.301732] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e6d7baac-4bff-46b9-b88d-2dc982621c0f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.342143] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.342813] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.343054] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.343448] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.343751] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.344337] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "port-e2eba435-515c-488d-b3bf-804164b2fef0" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.809432] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e6d7baac-4bff-46b9-b88d-2dc982621c0f: rpc.has_security_group_logging(os_id): False [ 642.835492] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.835492] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.835998] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.836086] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.836250] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.836530] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.836678] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.836778] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.837331] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.837331] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.837331] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.837566] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.837566] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.838562] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.838562] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.838562] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.838562] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.838562] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.838562] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.838562] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.839199] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e6d7baac-4bff-46b9-b88d-2dc982621c0f is going to be created. [ 642.875025] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cc04914d-716e-49e1-8a77-946f904f69bb in Status: SUCCESS [ 642.875025] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cc04914d-716e-49e1-8a77-946f904f69bb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.950656] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.950656] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.950656] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.950656] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.950656] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.969860] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e6d7baac-4bff-46b9-b88d-2dc982621c0f in Status: IN_PROGRESS for 2s [ 643.140658] env[65065]: INFO networking_nsxv3.common.synchronization [req-66641d21-232e-4b06-b768-2685fdf52f99 req-ff3b05f9-0383-4e34-b709-8e6952793b87 service nova] Enqueued Resource ID: 9576b45f-b344-47bd-8f8b-9df4c3725ddb with Priority: HIGHEST for action security_group_rules [ 643.140851] env[65065]: INFO networking_nsxv3.common.synchronization [req-66641d21-232e-4b06-b768-2685fdf52f99 req-ff3b05f9-0383-4e34-b709-8e6952793b87 service nova] Enqueued Resource ID: 9576b45f-b344-47bd-8f8b-9df4c3725ddb with Priority: HIGHEST for action security_group_members [ 643.140969] env[65065]: INFO networking_nsxv3.common.synchronization [req-66641d21-232e-4b06-b768-2685fdf52f99 req-ff3b05f9-0383-4e34-b709-8e6952793b87 service nova] Enqueued Resource ID: e2eba435-515c-488d-b3bf-804164b2fef0 with Priority: HIGHEST for action port [ 643.141912] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9576b45f-b344-47bd-8f8b-9df4c3725ddb with Priority: HIGHEST for action security_group_rules [ 643.142077] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9576b45f-b344-47bd-8f8b-9df4c3725ddb with Priority: HIGHEST for action security_group_members [ 643.142240] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2eba435-515c-488d-b3bf-804164b2fef0 with Priority: HIGHEST for action port [ 643.142598] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9576b45f-b344-47bd-8f8b-9df4c3725ddb taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.142766] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9576b45f-b344-47bd-8f8b-9df4c3725ddb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.142834] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9576b45f-b344-47bd-8f8b-9df4c3725ddb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.143820] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9576b45f-b344-47bd-8f8b-9df4c3725ddb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.143820] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9576b45f-b344-47bd-8f8b-9df4c3725ddb',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.144163] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-9576b45f-b344-47bd-8f8b-9df4c3725ddb taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.144809] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9576b45f-b344-47bd-8f8b-9df4c3725ddb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.144809] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9576b45f-b344-47bd-8f8b-9df4c3725ddb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.144809] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9576b45f-b344-47bd-8f8b-9df4c3725ddb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.144955] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.145112] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.145592] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.145592] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.145592] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.145592] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9576b45f-b344-47bd-8f8b-9df4c3725ddb',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.146690] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-e2eba435-515c-488d-b3bf-804164b2fef0 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.146820] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e2eba435-515c-488d-b3bf-804164b2fef0" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.146917] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e2eba435-515c-488d-b3bf-804164b2fef0" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.147806] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e2eba435-515c-488d-b3bf-804164b2fef0" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.147806] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e2eba435-515c-488d-b3bf-804164b2fef0',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.649182] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9576b45f-b344-47bd-8f8b-9df4c3725ddb',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.651999] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-9576b45f-b344-47bd-8f8b-9df4c3725ddb taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.651999] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9576b45f-b344-47bd-8f8b-9df4c3725ddb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.651999] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e2eba435-515c-488d-b3bf-804164b2fef0 with status ACTIVE [ 643.651999] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.651999] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.651999] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.651999] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.652409] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.652409] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.652409] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.652409] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.652614] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.652614] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.652776] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.652857] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.652915] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.653061] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.653128] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.653206] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e2eba435-515c-488d-b3bf-804164b2fef0 is going to be updated. [ 643.676484] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.676484] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.676484] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.676484] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.676484] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.676484] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e2eba435-515c-488d-b3bf-804164b2fef0" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.690017] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1cb445c1-075d-4f89-884f-a4bbf84030d0 in Status: SUCCESS [ 643.690423] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1cb445c1-075d-4f89-884f-a4bbf84030d0" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.690493] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1cb445c1-075d-4f89-884f-a4bbf84030d0" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.690732] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1cb445c1-075d-4f89-884f-a4bbf84030d0" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.691020] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.691200] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.691268] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.691554] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.691554] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.691708] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1cb445c1-075d-4f89-884f-a4bbf84030d0" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.692325] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-1cb445c1-075d-4f89-884f-a4bbf84030d0 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.692325] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1cb445c1-075d-4f89-884f-a4bbf84030d0" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.692325] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1cb445c1-075d-4f89-884f-a4bbf84030d0" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.692325] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1cb445c1-075d-4f89-884f-a4bbf84030d0" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.692610] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.692610] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.692693] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.693077] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.693077] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.693077] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1cb445c1-075d-4f89-884f-a4bbf84030d0" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.693391] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1cb445c1-075d-4f89-884f-a4bbf84030d0',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.694437] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1cb445c1-075d-4f89-884f-a4bbf84030d0" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.694651] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1cb445c1-075d-4f89-884f-a4bbf84030d0" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.694862] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.695046] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.695159] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.695544] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.695796] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.695916] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1cb445c1-075d-4f89-884f-a4bbf84030d0',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.756322] env[65065]: INFO networking_nsxv3.common.synchronization [req-4bf83618-de7a-4b4e-9396-4f177d7d6847 req-af0b79f6-4c3a-4371-bd41-6c54b4d599b1 tempest-ServerTagsTestJSON-1316947547 tempest-ServerTagsTestJSON-1316947547-project-member] Enqueued Resource ID: e4ff6072-a232-4ebe-b049-2085dcef5991 with Priority: HIGHEST for action security_group_members [ 643.756322] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4ff6072-a232-4ebe-b049-2085dcef5991 with Priority: HIGHEST for action security_group_members [ 643.756322] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4ff6072-a232-4ebe-b049-2085dcef5991 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.756322] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4ff6072-a232-4ebe-b049-2085dcef5991" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.756322] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4ff6072-a232-4ebe-b049-2085dcef5991" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.756653] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4ff6072-a232-4ebe-b049-2085dcef5991" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.757732] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.757732] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.757732] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.757732] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.757732] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.757732] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e4ff6072-a232-4ebe-b049-2085dcef5991',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.137280] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock network-961 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.137280] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "network-961" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.137280] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "network-961" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.137280] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "network-961" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.137280] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.137280] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.137280] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.137739] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.137739] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.137836] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 644.137887] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 644.137993] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 644.138106] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 644.138208] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 644.138342] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 644.138541] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 644.152522] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9576b45f-b344-47bd-8f8b-9df4c3725ddb',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.158873] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 644.159044] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 644.159177] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 644.159341] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "network-961" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.159646] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock port-20dd8524-3b05-459b-aae4-b755e5f62c7f taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.159837] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "port-20dd8524-3b05-459b-aae4-b755e5f62c7f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.159930] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "port-20dd8524-3b05-459b-aae4-b755e5f62c7f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.160263] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "port-20dd8524-3b05-459b-aae4-b755e5f62c7f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.160394] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('20dd8524-3b05-459b-aae4-b755e5f62c7f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.198066] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1cb445c1-075d-4f89-884f-a4bbf84030d0: rpc.has_security_group_logging(os_id): False [ 644.199299] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1cb445c1-075d-4f89-884f-a4bbf84030d0',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.216955] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.216955] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.216955] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.217329] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.217329] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.217524] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.217628] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.217686] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.217843] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.217919] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.218138] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.218278] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.218370] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.218586] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.218647] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.218815] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.218899] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.218965] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.219114] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.219187] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.219271] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1cb445c1-075d-4f89-884f-a4bbf84030d0 is going to be created. [ 644.261525] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.261686] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.261749] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.261974] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.262166] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.262283] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.262426] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.262426] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.262582] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.262711] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.262766] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e4ff6072-a232-4ebe-b049-2085dcef5991 already deleted. [ 644.262838] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4ff6072-a232-4ebe-b049-2085dcef5991" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.282640] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.282824] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.282824] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.284346] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.284346] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.300134] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1cb445c1-075d-4f89-884f-a4bbf84030d0 in Status: IN_PROGRESS for 2s [ 644.654906] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.655310] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.655310] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.655515] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.655632] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.655758] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9576b45f-b344-47bd-8f8b-9df4c3725ddb is going to be created. [ 644.664979] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.665300] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.665455] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.665770] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.665931] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.666146] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Segment Port 20dd8524-3b05-459b-aae4-b755e5f62c7f not found, creating... [ 644.666364] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.666561] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.666687] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.667102] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.667102] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.667414] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.667577] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.667691] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.667898] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.668048] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.668185] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Resource: SegmentPort with ID: 20dd8524-3b05-459b-aae4-b755e5f62c7f is going to be created. [ 644.683119] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.683300] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.683365] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.683604] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.683818] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.693740] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.693964] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.694087] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.694345] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.694572] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.694782] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "port-20dd8524-3b05-459b-aae4-b755e5f62c7f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.696365] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9576b45f-b344-47bd-8f8b-9df4c3725ddb in Status: UNINITIALIZED for 2s [ 644.701225] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1cb445c1-075d-4f89-884f-a4bbf84030d0',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.983923] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e6d7baac-4bff-46b9-b88d-2dc982621c0f in Status: SUCCESS [ 644.983923] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.083851] env[65065]: INFO networking_nsxv3.common.synchronization [req-913ad5b0-8d38-4e58-9349-b278893e31d0 req-e4f99510-2f15-4d18-9fd8-9c5dc2a71c81 tempest-SecurityGroupRulesNegativeTestJSON-722195855 tempest-SecurityGroupRulesNegativeTestJSON-722195855-project-member] Enqueued Resource ID: 47b1df8e-a0e7-4e08-86e1-7802829e32e3 with Priority: HIGHEST for action security_group_rules [ 645.085906] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47b1df8e-a0e7-4e08-86e1-7802829e32e3 with Priority: HIGHEST for action security_group_rules [ 645.086351] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-47b1df8e-a0e7-4e08-86e1-7802829e32e3 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.086493] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-47b1df8e-a0e7-4e08-86e1-7802829e32e3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.086551] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-47b1df8e-a0e7-4e08-86e1-7802829e32e3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.088187] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-47b1df8e-a0e7-4e08-86e1-7802829e32e3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.088187] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('47b1df8e-a0e7-4e08-86e1-7802829e32e3',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.205249] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.206249] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.206249] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.206249] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.206249] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.206249] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1cb445c1-075d-4f89-884f-a4bbf84030d0 is going to be updated. [ 645.246965] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.247482] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.247482] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.247642] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.247642] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.261648] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1cb445c1-075d-4f89-884f-a4bbf84030d0 in Status: IN_PROGRESS for 2s [ 645.612329] env[65065]: INFO networking_nsxv3.common.synchronization [req-4bf83618-de7a-4b4e-9396-4f177d7d6847 req-09536145-01c3-49e5-a6bb-1077eaa205af service nova] Enqueued Resource ID: e4ff6072-a232-4ebe-b049-2085dcef5991 with Priority: HIGHEST for action security_group_rules [ 645.612648] env[65065]: INFO networking_nsxv3.common.synchronization [req-4bf83618-de7a-4b4e-9396-4f177d7d6847 req-09536145-01c3-49e5-a6bb-1077eaa205af service nova] Enqueued Resource ID: e4ff6072-a232-4ebe-b049-2085dcef5991 with Priority: HIGHEST for action security_group_members [ 645.612847] env[65065]: INFO networking_nsxv3.common.synchronization [req-4bf83618-de7a-4b4e-9396-4f177d7d6847 req-09536145-01c3-49e5-a6bb-1077eaa205af service nova] Enqueued Resource ID: 20dd8524-3b05-459b-aae4-b755e5f62c7f with Priority: HIGHEST for action port [ 645.614343] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4ff6072-a232-4ebe-b049-2085dcef5991 with Priority: HIGHEST for action security_group_rules [ 645.614713] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4ff6072-a232-4ebe-b049-2085dcef5991 with Priority: HIGHEST for action security_group_members [ 645.614713] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20dd8524-3b05-459b-aae4-b755e5f62c7f with Priority: HIGHEST for action port [ 645.618045] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e4ff6072-a232-4ebe-b049-2085dcef5991 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.619031] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e4ff6072-a232-4ebe-b049-2085dcef5991" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.619129] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e4ff6072-a232-4ebe-b049-2085dcef5991" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.619462] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e4ff6072-a232-4ebe-b049-2085dcef5991" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.619599] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e4ff6072-a232-4ebe-b049-2085dcef5991',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.620838] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4ff6072-a232-4ebe-b049-2085dcef5991 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.621028] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4ff6072-a232-4ebe-b049-2085dcef5991" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.621112] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4ff6072-a232-4ebe-b049-2085dcef5991" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.621326] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4ff6072-a232-4ebe-b049-2085dcef5991" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.621538] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.621604] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.621648] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.621790] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.621863] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.622099] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e4ff6072-a232-4ebe-b049-2085dcef5991',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.626983] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-20dd8524-3b05-459b-aae4-b755e5f62c7f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.626983] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-20dd8524-3b05-459b-aae4-b755e5f62c7f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.626983] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-20dd8524-3b05-459b-aae4-b755e5f62c7f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.626983] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-20dd8524-3b05-459b-aae4-b755e5f62c7f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.626983] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('20dd8524-3b05-459b-aae4-b755e5f62c7f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.627791] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.627928] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.628130] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.628375] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.628606] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.628671] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 47b1df8e-a0e7-4e08-86e1-7802829e32e3 already deleted. [ 645.628756] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-47b1df8e-a0e7-4e08-86e1-7802829e32e3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.950391] env[65065]: INFO networking_nsxv3.common.synchronization [req-1d132eb7-1ba9-4ded-9ac1-86dd11e3333d req-87643ee4-4381-47e9-8ff6-f5898858f668 tempest-InstanceActionsTestJSON-20090509 tempest-InstanceActionsTestJSON-20090509-project-member] Enqueued Resource ID: 4a714159-17dd-4324-93b8-81c81e256b0e with Priority: HIGHEST for action security_group_members [ 645.950933] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a714159-17dd-4324-93b8-81c81e256b0e with Priority: HIGHEST for action security_group_members [ 645.951246] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a714159-17dd-4324-93b8-81c81e256b0e taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.951384] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a714159-17dd-4324-93b8-81c81e256b0e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.951467] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a714159-17dd-4324-93b8-81c81e256b0e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.951670] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a714159-17dd-4324-93b8-81c81e256b0e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.951878] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.951878] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.953290] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.953290] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.953290] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.953290] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4a714159-17dd-4324-93b8-81c81e256b0e',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.128429] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 20dd8524-3b05-459b-aae4-b755e5f62c7f with status ACTIVE [ 646.128429] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.128429] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.128429] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.128429] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.128429] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.128728] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.128917] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.128979] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.129170] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.129253] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.129443] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.129587] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.129899] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.130035] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.130513] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.130659] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 20dd8524-3b05-459b-aae4-b755e5f62c7f is going to be updated. [ 646.131917] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4ff6072-a232-4ebe-b049-2085dcef5991 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.132090] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4ff6072-a232-4ebe-b049-2085dcef5991" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.132751] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e4ff6072-a232-4ebe-b049-2085dcef5991',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.156362] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.156362] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.156362] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.156362] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.156799] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.156799] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-20dd8524-3b05-459b-aae4-b755e5f62c7f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.335703] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1cb445c1-075d-4f89-884f-a4bbf84030d0 in Status: SUCCESS [ 646.336230] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1cb445c1-075d-4f89-884f-a4bbf84030d0" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.336230] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1cb445c1-075d-4f89-884f-a4bbf84030d0" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.336417] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1cb445c1-075d-4f89-884f-a4bbf84030d0" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.336512] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1cb445c1-075d-4f89-884f-a4bbf84030d0',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.455911] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.456570] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.456570] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.456570] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.456570] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.457009] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.457009] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.457009] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.457609] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.457609] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.457609] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4a714159-17dd-4324-93b8-81c81e256b0e is going to be updated. [ 646.466661] env[65065]: INFO networking_nsxv3.common.synchronization [req-ea636c2d-b94f-4075-9c9c-9670db5b8a46 req-c6f4f229-5d2a-47e0-8e87-ba9efdd76fb3 tempest-DeleteServersAdminTestJSON-854701151 tempest-DeleteServersAdminTestJSON-854701151-project-member] Enqueued Resource ID: 5501386c-6d40-4911-b095-561660dd038b with Priority: HIGHEST for action security_group_members [ 646.467338] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5501386c-6d40-4911-b095-561660dd038b with Priority: HIGHEST for action security_group_members [ 646.467873] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-5501386c-6d40-4911-b095-561660dd038b taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.467873] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5501386c-6d40-4911-b095-561660dd038b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.468154] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5501386c-6d40-4911-b095-561660dd038b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.468256] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5501386c-6d40-4911-b095-561660dd038b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.468395] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.468522] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.468586] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.468759] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.468936] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.470724] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5501386c-6d40-4911-b095-561660dd038b',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.499375] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.499530] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.499632] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.499862] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.499961] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.515268] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a714159-17dd-4324-93b8-81c81e256b0e in Status: IN_PROGRESS for 2s [ 646.635061] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e4ff6072-a232-4ebe-b049-2085dcef5991',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.710537] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9576b45f-b344-47bd-8f8b-9df4c3725ddb in Status: SUCCESS [ 646.710693] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9576b45f-b344-47bd-8f8b-9df4c3725ddb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.710752] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9576b45f-b344-47bd-8f8b-9df4c3725ddb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.710969] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9576b45f-b344-47bd-8f8b-9df4c3725ddb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.711191] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.711327] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.711368] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.711530] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.711613] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.711727] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9576b45f-b344-47bd-8f8b-9df4c3725ddb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.711783] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9576b45f-b344-47bd-8f8b-9df4c3725ddb',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.840594] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-1cb445c1-075d-4f89-884f-a4bbf84030d0 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.841328] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1cb445c1-075d-4f89-884f-a4bbf84030d0" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.908065] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock network-11 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.908579] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "network-11" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.908579] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "network-11" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.908730] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "network-11" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.908890] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.909294] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.909479] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.909750] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.909933] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.910183] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 646.910326] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 646.910459] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 646.910586] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 646.910739] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 646.910875] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 646.911044] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 646.932886] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 646.933040] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 646.933176] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 646.933343] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "network-11" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.933695] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock port-449e01bb-7d71-41a3-8ead-8197586c9293 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.933851] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "port-449e01bb-7d71-41a3-8ead-8197586c9293" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.933963] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "port-449e01bb-7d71-41a3-8ead-8197586c9293" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.934339] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "port-449e01bb-7d71-41a3-8ead-8197586c9293" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.934475] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('449e01bb-7d71-41a3-8ead-8197586c9293',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.973262] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.973689] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.973689] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.974106] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.974348] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.974708] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.978415] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.978415] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.978415] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.978415] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.978415] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5501386c-6d40-4911-b095-561660dd038b is going to be updated. [ 647.008905] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.009230] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.009344] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.009570] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.009770] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.024214] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5501386c-6d40-4911-b095-561660dd038b in Status: IN_PROGRESS for 2s [ 647.140397] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.140601] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.140752] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.141860] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.141860] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.141860] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e4ff6072-a232-4ebe-b049-2085dcef5991 is going to be created. [ 647.175253] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.175494] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.175565] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.175778] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.176186] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.189473] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4ff6072-a232-4ebe-b049-2085dcef5991 in Status: UNINITIALIZED for 2s [ 647.216683] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9576b45f-b344-47bd-8f8b-9df4c3725ddb',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.277874] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1cb445c1-075d-4f89-884f-a4bbf84030d0 in Status: SUCCESS [ 647.278267] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1cb445c1-075d-4f89-884f-a4bbf84030d0" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.278368] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1cb445c1-075d-4f89-884f-a4bbf84030d0" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.278602] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1cb445c1-075d-4f89-884f-a4bbf84030d0" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.278832] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.279152] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.279152] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.279252] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.279285] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.279360] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1cb445c1-075d-4f89-884f-a4bbf84030d0" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.279824] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1cb445c1-075d-4f89-884f-a4bbf84030d0',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.437117] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.437445] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.437572] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.437894] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.438088] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.438264] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Segment Port 449e01bb-7d71-41a3-8ead-8197586c9293 not found, creating... [ 647.438598] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.438759] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.438870] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.439135] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.439280] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.439594] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.439743] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.439867] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.440119] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.440273] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.440513] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Resource: SegmentPort with ID: 449e01bb-7d71-41a3-8ead-8197586c9293 is going to be created. [ 647.464180] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.464405] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.464534] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.464825] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.465091] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.465346] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "port-449e01bb-7d71-41a3-8ead-8197586c9293" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.722451] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9576b45f-b344-47bd-8f8b-9df4c3725ddb: rpc.has_security_group_logging(os_id): False [ 647.743362] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.743551] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.743624] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.743835] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.743927] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.744174] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.744273] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.744337] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.744482] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.744557] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.744642] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9576b45f-b344-47bd-8f8b-9df4c3725ddb is going to be created. [ 647.783782] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-1cb445c1-075d-4f89-884f-a4bbf84030d0 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.784033] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1cb445c1-075d-4f89-884f-a4bbf84030d0" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.784130] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1cb445c1-075d-4f89-884f-a4bbf84030d0" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.784344] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1cb445c1-075d-4f89-884f-a4bbf84030d0" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.784530] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.784635] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.784703] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.784832] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.784917] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.785019] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1cb445c1-075d-4f89-884f-a4bbf84030d0" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.785165] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-1cb445c1-075d-4f89-884f-a4bbf84030d0 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.785260] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1cb445c1-075d-4f89-884f-a4bbf84030d0" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.785331] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1cb445c1-075d-4f89-884f-a4bbf84030d0" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.785457] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1cb445c1-075d-4f89-884f-a4bbf84030d0" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.785595] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.785685] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.785744] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.785876] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.785952] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.786047] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1cb445c1-075d-4f89-884f-a4bbf84030d0" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.786136] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1cb445c1-075d-4f89-884f-a4bbf84030d0',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.804212] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.804432] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.804432] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.804643] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.804821] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.818442] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9576b45f-b344-47bd-8f8b-9df4c3725ddb in Status: IN_PROGRESS for 2s [ 648.238050] env[65065]: INFO networking_nsxv3.common.synchronization [req-ea636c2d-b94f-4075-9c9c-9670db5b8a46 req-8e478a0f-62a5-470e-b15b-fc6f56e6afa6 service nova] Enqueued Resource ID: 5501386c-6d40-4911-b095-561660dd038b with Priority: HIGHEST for action security_group_rules [ 648.238050] env[65065]: INFO networking_nsxv3.common.synchronization [req-ea636c2d-b94f-4075-9c9c-9670db5b8a46 req-8e478a0f-62a5-470e-b15b-fc6f56e6afa6 service nova] Enqueued Resource ID: 5501386c-6d40-4911-b095-561660dd038b with Priority: HIGHEST for action security_group_members [ 648.238050] env[65065]: INFO networking_nsxv3.common.synchronization [req-ea636c2d-b94f-4075-9c9c-9670db5b8a46 req-8e478a0f-62a5-470e-b15b-fc6f56e6afa6 service nova] Enqueued Resource ID: 449e01bb-7d71-41a3-8ead-8197586c9293 with Priority: HIGHEST for action port [ 648.239960] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5501386c-6d40-4911-b095-561660dd038b with Priority: HIGHEST for action security_group_rules [ 648.239960] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5501386c-6d40-4911-b095-561660dd038b with Priority: HIGHEST for action security_group_members [ 648.239960] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 449e01bb-7d71-41a3-8ead-8197586c9293 with Priority: HIGHEST for action port [ 648.239960] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5501386c-6d40-4911-b095-561660dd038b taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.242391] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5501386c-6d40-4911-b095-561660dd038b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.242391] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5501386c-6d40-4911-b095-561660dd038b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.242391] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5501386c-6d40-4911-b095-561660dd038b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.242391] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5501386c-6d40-4911-b095-561660dd038b',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.242391] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-5501386c-6d40-4911-b095-561660dd038b taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.242391] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5501386c-6d40-4911-b095-561660dd038b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.242733] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-449e01bb-7d71-41a3-8ead-8197586c9293 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.245892] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-449e01bb-7d71-41a3-8ead-8197586c9293" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.245892] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-449e01bb-7d71-41a3-8ead-8197586c9293" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.245892] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-449e01bb-7d71-41a3-8ead-8197586c9293" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.245892] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('449e01bb-7d71-41a3-8ead-8197586c9293',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.288681] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1cb445c1-075d-4f89-884f-a4bbf84030d0: rpc.has_security_group_logging(os_id): False [ 648.310273] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.310420] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.310557] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.310731] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.310844] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.311077] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.311232] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.311232] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.311448] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.311503] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.311733] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.312117] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.312117] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.312117] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.312804] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.313402] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.315085] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.315085] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.315085] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.315085] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.315085] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1cb445c1-075d-4f89-884f-a4bbf84030d0 is going to be updated. [ 648.390427] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.390626] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.390722] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.390970] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.391203] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.408363] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1cb445c1-075d-4f89-884f-a4bbf84030d0 in Status: IN_PROGRESS for 2s [ 648.530092] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a714159-17dd-4324-93b8-81c81e256b0e in Status: SUCCESS [ 648.530442] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4a714159-17dd-4324-93b8-81c81e256b0e deletion is rescheduled due to dependency. [ 648.530638] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a714159-17dd-4324-93b8-81c81e256b0e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.747721] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-5501386c-6d40-4911-b095-561660dd038b taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.748588] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5501386c-6d40-4911-b095-561660dd038b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.748588] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 449e01bb-7d71-41a3-8ead-8197586c9293 with status ACTIVE [ 648.748892] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.748892] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.749039] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.749256] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.749256] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.749510] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.749510] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.749634] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.749722] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.749799] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.749981] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.750087] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.750148] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.750288] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.750375] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.750570] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 449e01bb-7d71-41a3-8ead-8197586c9293 is going to be updated. [ 648.779283] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.779283] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.779283] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.779283] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.779283] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.779283] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-449e01bb-7d71-41a3-8ead-8197586c9293" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.037546] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5501386c-6d40-4911-b095-561660dd038b in Status: SUCCESS [ 649.037710] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5501386c-6d40-4911-b095-561660dd038b deletion is rescheduled due to dependency. [ 649.037951] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5501386c-6d40-4911-b095-561660dd038b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.038168] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5501386c-6d40-4911-b095-561660dd038b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.038363] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5501386c-6d40-4911-b095-561660dd038b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.039478] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.039478] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.039478] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.039478] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.039478] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.039478] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5501386c-6d40-4911-b095-561660dd038b',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.126342] env[65065]: INFO networking_nsxv3.common.synchronization [req-b21125c9-70d0-4bb1-a175-3fb0438c8dc6 req-7db73178-ce90-409f-93a6-9e413de3faaf tempest-SecurityGroupsTestJSON-312946932 tempest-SecurityGroupsTestJSON-312946932-project-member] Enqueued Resource ID: 99423afc-7fd3-4e3d-8a84-f190e0af048f with Priority: HIGHEST for action security_group_members [ 649.127150] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99423afc-7fd3-4e3d-8a84-f190e0af048f with Priority: HIGHEST for action security_group_members [ 649.128583] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-99423afc-7fd3-4e3d-8a84-f190e0af048f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.128583] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.128583] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.129094] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.129311] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.129842] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.129842] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.129842] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.129842] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.130081] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('99423afc-7fd3-4e3d-8a84-f190e0af048f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.203238] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4ff6072-a232-4ebe-b049-2085dcef5991 in Status: SUCCESS [ 649.205476] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4ff6072-a232-4ebe-b049-2085dcef5991" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.205476] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4ff6072-a232-4ebe-b049-2085dcef5991" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.205476] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4ff6072-a232-4ebe-b049-2085dcef5991" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.205476] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.205476] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.205476] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.205476] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.205476] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.205476] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4ff6072-a232-4ebe-b049-2085dcef5991" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.205476] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e4ff6072-a232-4ebe-b049-2085dcef5991',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.383471] env[65065]: INFO networking_nsxv3.common.synchronization [None req-220dabc2-ea80-434c-b140-6c4caa41b4ba None None] Enqueued Resource ID: 4d1f6ed4-b83f-4780-9ac5-984bf1267c93 with Priority: HIGHEST for action port [ 649.384593] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d1f6ed4-b83f-4780-9ac5-984bf1267c93 with Priority: HIGHEST for action port [ 649.384947] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-4d1f6ed4-b83f-4780-9ac5-984bf1267c93 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.385248] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4d1f6ed4-b83f-4780-9ac5-984bf1267c93" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.385557] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4d1f6ed4-b83f-4780-9ac5-984bf1267c93" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.385910] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4d1f6ed4-b83f-4780-9ac5-984bf1267c93" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.385910] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4d1f6ed4-b83f-4780-9ac5-984bf1267c93',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.541599] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5501386c-6d40-4911-b095-561660dd038b',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.621087] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock network-145 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.621370] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "network-145" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.621513] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "network-145" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.621879] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "network-145" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.622167] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.622369] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.622523] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.622783] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.622975] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.623206] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 649.623363] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 649.623640] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 649.623693] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 649.623801] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 649.623936] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 649.624154] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 649.632536] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.632749] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.632860] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.633205] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.633373] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.633876] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.633876] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.633876] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.634172] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.634294] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.634346] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99423afc-7fd3-4e3d-8a84-f190e0af048f already deleted. [ 649.634434] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.647136] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 649.647136] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 649.647136] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 649.647136] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "network-145" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.647526] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock port-35664542-e3b2-4aac-b216-ec2d6142eecf taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.647526] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "port-35664542-e3b2-4aac-b216-ec2d6142eecf" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.647652] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "port-35664542-e3b2-4aac-b216-ec2d6142eecf" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.647912] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "port-35664542-e3b2-4aac-b216-ec2d6142eecf" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.648027] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('35664542-e3b2-4aac-b216-ec2d6142eecf',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.710745] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4ff6072-a232-4ebe-b049-2085dcef5991 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.710745] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4ff6072-a232-4ebe-b049-2085dcef5991" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.710745] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4ff6072-a232-4ebe-b049-2085dcef5991" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.710745] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4ff6072-a232-4ebe-b049-2085dcef5991" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.710745] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.710745] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.710745] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.710745] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.710745] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.710745] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4ff6072-a232-4ebe-b049-2085dcef5991" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.710745] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4ff6072-a232-4ebe-b049-2085dcef5991 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.710745] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4ff6072-a232-4ebe-b049-2085dcef5991" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.710745] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4ff6072-a232-4ebe-b049-2085dcef5991" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.710745] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4ff6072-a232-4ebe-b049-2085dcef5991" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.710745] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.710745] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.711521] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.711521] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.711521] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.711521] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4ff6072-a232-4ebe-b049-2085dcef5991" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.711521] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e4ff6072-a232-4ebe-b049-2085dcef5991',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.834833] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9576b45f-b344-47bd-8f8b-9df4c3725ddb in Status: SUCCESS [ 649.835078] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9576b45f-b344-47bd-8f8b-9df4c3725ddb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.889155] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4d1f6ed4-b83f-4780-9ac5-984bf1267c93 [ 649.889393] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.889533] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.889605] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.889836] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.889923] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.890031] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4d1f6ed4-b83f-4780-9ac5-984bf1267c93 already deleted. [ 649.890115] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4d1f6ed4-b83f-4780-9ac5-984bf1267c93" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.049186] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5501386c-6d40-4911-b095-561660dd038b',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.154087] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.154087] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.154087] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.154087] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.154087] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.154087] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Segment Port 35664542-e3b2-4aac-b216-ec2d6142eecf not found, creating... [ 650.154087] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.154087] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.154087] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.154087] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.154087] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.154872] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.154980] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.155583] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.155583] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.156450] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.156812] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Resource: SegmentPort with ID: 35664542-e3b2-4aac-b216-ec2d6142eecf is going to be created. [ 650.182649] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.182649] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.182649] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.182649] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.182649] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.182649] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "port-35664542-e3b2-4aac-b216-ec2d6142eecf" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.214315] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e4ff6072-a232-4ebe-b049-2085dcef5991: rpc.has_security_group_logging(os_id): False [ 650.259842] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.259842] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.260113] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.260304] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.260479] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.260723] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.260831] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.261255] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.261255] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.261255] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.261480] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.261681] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.261784] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.261987] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.262126] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.262380] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.262519] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.262645] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.262846] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.262984] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.263053] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e4ff6072-a232-4ebe-b049-2085dcef5991 is going to be created. [ 650.343590] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.343821] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.343903] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.344542] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.344542] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.357792] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e4ff6072-a232-4ebe-b049-2085dcef5991 in Status: IN_PROGRESS for 2s [ 650.442336] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1cb445c1-075d-4f89-884f-a4bbf84030d0 in Status: SUCCESS [ 650.442700] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1cb445c1-075d-4f89-884f-a4bbf84030d0" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.551757] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.551978] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.552084] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.552407] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.552579] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.552736] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5501386c-6d40-4911-b095-561660dd038b is going to be updated. [ 650.592300] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.592490] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.592584] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.592812] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.592970] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.604841] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5501386c-6d40-4911-b095-561660dd038b in Status: IN_PROGRESS for 2s [ 650.951475] env[65065]: INFO networking_nsxv3.common.synchronization [req-b21125c9-70d0-4bb1-a175-3fb0438c8dc6 req-6c25edc1-7711-48a9-9318-cb2635927b95 service nova] Enqueued Resource ID: 99423afc-7fd3-4e3d-8a84-f190e0af048f with Priority: HIGHEST for action security_group_rules [ 650.951652] env[65065]: INFO networking_nsxv3.common.synchronization [req-b21125c9-70d0-4bb1-a175-3fb0438c8dc6 req-6c25edc1-7711-48a9-9318-cb2635927b95 service nova] Enqueued Resource ID: 99423afc-7fd3-4e3d-8a84-f190e0af048f with Priority: HIGHEST for action security_group_members [ 650.952423] env[65065]: INFO networking_nsxv3.common.synchronization [req-b21125c9-70d0-4bb1-a175-3fb0438c8dc6 req-6c25edc1-7711-48a9-9318-cb2635927b95 service nova] Enqueued Resource ID: 35664542-e3b2-4aac-b216-ec2d6142eecf with Priority: HIGHEST for action port [ 650.953490] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99423afc-7fd3-4e3d-8a84-f190e0af048f with Priority: HIGHEST for action security_group_rules [ 650.953835] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99423afc-7fd3-4e3d-8a84-f190e0af048f with Priority: HIGHEST for action security_group_members [ 650.957346] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35664542-e3b2-4aac-b216-ec2d6142eecf with Priority: HIGHEST for action port [ 650.957346] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-99423afc-7fd3-4e3d-8a84-f190e0af048f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.957346] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.957346] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.957346] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.957346] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('99423afc-7fd3-4e3d-8a84-f190e0af048f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.960644] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-99423afc-7fd3-4e3d-8a84-f190e0af048f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.960644] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.960644] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.961416] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.961416] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.963928] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.963928] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.963928] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.963928] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.963928] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('99423afc-7fd3-4e3d-8a84-f190e0af048f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.964905] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-35664542-e3b2-4aac-b216-ec2d6142eecf taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.964905] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-35664542-e3b2-4aac-b216-ec2d6142eecf" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.964905] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-35664542-e3b2-4aac-b216-ec2d6142eecf" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.964905] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-35664542-e3b2-4aac-b216-ec2d6142eecf" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.968226] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('35664542-e3b2-4aac-b216-ec2d6142eecf',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.468050] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-99423afc-7fd3-4e3d-8a84-f190e0af048f taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.469899] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.470471] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('99423afc-7fd3-4e3d-8a84-f190e0af048f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.473294] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 35664542-e3b2-4aac-b216-ec2d6142eecf with status ACTIVE [ 651.473294] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.473294] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.473294] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.473576] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.473576] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.473643] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.473741] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.473805] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.474113] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.474113] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.474235] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.474326] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.474383] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.474519] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.474592] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.475487] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 35664542-e3b2-4aac-b216-ec2d6142eecf is going to be updated. [ 651.507444] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.508162] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.508334] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.508711] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.509888] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.510317] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-35664542-e3b2-4aac-b216-ec2d6142eecf" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.979570] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('99423afc-7fd3-4e3d-8a84-f190e0af048f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.392195] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e4ff6072-a232-4ebe-b049-2085dcef5991 in Status: SUCCESS [ 652.392345] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e4ff6072-a232-4ebe-b049-2085dcef5991" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.446682] env[65065]: INFO networking_nsxv3.common.synchronization [None req-3c2be8fd-6b3a-4457-af6d-ac2cf2da2508 None None] Enqueued Resource ID: 328c7e77-9e0c-45b3-878f-23a34b5706e1 with Priority: HIGHEST for action port [ 652.448029] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 328c7e77-9e0c-45b3-878f-23a34b5706e1 with Priority: HIGHEST for action port [ 652.451032] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-328c7e77-9e0c-45b3-878f-23a34b5706e1 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.451032] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-328c7e77-9e0c-45b3-878f-23a34b5706e1" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.451032] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-328c7e77-9e0c-45b3-878f-23a34b5706e1" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.451032] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-328c7e77-9e0c-45b3-878f-23a34b5706e1" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.451032] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('328c7e77-9e0c-45b3-878f-23a34b5706e1',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.482282] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.482948] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.482948] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.482948] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.482948] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.482948] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99423afc-7fd3-4e3d-8a84-f190e0af048f is going to be created. [ 652.513800] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.513800] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.513800] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.514364] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.514609] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.527633] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99423afc-7fd3-4e3d-8a84-f190e0af048f in Status: UNINITIALIZED for 2s [ 652.618118] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5501386c-6d40-4911-b095-561660dd038b in Status: SUCCESS [ 652.622386] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5501386c-6d40-4911-b095-561660dd038b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.622386] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5501386c-6d40-4911-b095-561660dd038b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.622386] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5501386c-6d40-4911-b095-561660dd038b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.622386] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.622386] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.622386] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.622386] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.622386] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.622386] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5501386c-6d40-4911-b095-561660dd038b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.622386] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5501386c-6d40-4911-b095-561660dd038b',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.954132] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 328c7e77-9e0c-45b3-878f-23a34b5706e1 [ 652.954493] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.954638] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.954732] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.954988] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.955123] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.955258] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:328c7e77-9e0c-45b3-878f-23a34b5706e1 already deleted. [ 652.955328] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-328c7e77-9e0c-45b3-878f-23a34b5706e1" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.126859] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-5501386c-6d40-4911-b095-561660dd038b taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.127216] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5501386c-6d40-4911-b095-561660dd038b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.127216] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5501386c-6d40-4911-b095-561660dd038b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.127473] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5501386c-6d40-4911-b095-561660dd038b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.127946] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.127946] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.127946] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.128198] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.128198] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.128373] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5501386c-6d40-4911-b095-561660dd038b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.128373] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-5501386c-6d40-4911-b095-561660dd038b taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.128498] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5501386c-6d40-4911-b095-561660dd038b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.128550] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5501386c-6d40-4911-b095-561660dd038b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.128801] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5501386c-6d40-4911-b095-561660dd038b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.129667] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.129667] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.129667] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.129667] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.129667] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.129667] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5501386c-6d40-4911-b095-561660dd038b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.131402] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5501386c-6d40-4911-b095-561660dd038b',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.637117] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5501386c-6d40-4911-b095-561660dd038b: rpc.has_security_group_logging(os_id): False [ 653.663300] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.663300] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.663300] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.664225] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.664349] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.664574] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.664684] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.664765] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.664940] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.665032] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.665568] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.665568] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.665568] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.665895] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.665895] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.665960] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.666022] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.666379] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.666605] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.666709] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.666836] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5501386c-6d40-4911-b095-561660dd038b is going to be updated. [ 653.762608] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.762608] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.762608] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.762843] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.762878] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.779826] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5501386c-6d40-4911-b095-561660dd038b in Status: IN_PROGRESS for 2s [ 654.543242] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99423afc-7fd3-4e3d-8a84-f190e0af048f in Status: SUCCESS [ 654.543242] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.543242] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.543242] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.543242] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.543242] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.543242] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.543242] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.543242] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.543242] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.543242] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('99423afc-7fd3-4e3d-8a84-f190e0af048f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.608061] env[65065]: INFO networking_nsxv3.common.synchronization [None req-a05fd48e-682d-456f-adab-3d804f7f8f68 None None] Enqueued Resource ID: b9240b3e-e134-4166-8021-e24ed79d84ed with Priority: HIGHEST for action port [ 654.610017] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9240b3e-e134-4166-8021-e24ed79d84ed with Priority: HIGHEST for action port [ 654.610017] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-b9240b3e-e134-4166-8021-e24ed79d84ed taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.610017] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b9240b3e-e134-4166-8021-e24ed79d84ed" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.610017] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b9240b3e-e134-4166-8021-e24ed79d84ed" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.610017] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b9240b3e-e134-4166-8021-e24ed79d84ed" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.610017] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b9240b3e-e134-4166-8021-e24ed79d84ed',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.955687] env[65065]: INFO networking_nsxv3.common.synchronization [req-ca422e04-d09b-48a8-be0b-4719eda2b745 req-eeac7021-d702-418a-b109-6db34ae61508 tempest-TenantUsagesTestJSON-1261751082 tempest-TenantUsagesTestJSON-1261751082-project-member] Enqueued Resource ID: 39a21d13-3ed6-45f8-bfde-b892e16df2e1 with Priority: HIGHEST for action security_group_members [ 654.956716] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39a21d13-3ed6-45f8-bfde-b892e16df2e1 with Priority: HIGHEST for action security_group_members [ 654.957060] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-39a21d13-3ed6-45f8-bfde-b892e16df2e1 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.957190] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39a21d13-3ed6-45f8-bfde-b892e16df2e1" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.957255] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39a21d13-3ed6-45f8-bfde-b892e16df2e1" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.957566] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39a21d13-3ed6-45f8-bfde-b892e16df2e1" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.957744] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.957880] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.957965] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.958131] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.958220] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.958315] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('39a21d13-3ed6-45f8-bfde-b892e16df2e1',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.044747] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-99423afc-7fd3-4e3d-8a84-f190e0af048f taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.044935] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.044999] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.045307] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.045766] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.045766] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.045766] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.045938] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.046107] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.046147] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.048449] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-99423afc-7fd3-4e3d-8a84-f190e0af048f taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.048449] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.048449] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.048449] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.048449] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.048449] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.048449] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.048449] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.048449] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.048449] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.048449] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('99423afc-7fd3-4e3d-8a84-f190e0af048f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.113052] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b9240b3e-e134-4166-8021-e24ed79d84ed [ 655.113052] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.113052] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.113052] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.113052] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.113403] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.113403] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b9240b3e-e134-4166-8021-e24ed79d84ed already deleted. [ 655.113403] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b9240b3e-e134-4166-8021-e24ed79d84ed" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.461515] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.461666] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.461734] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.461971] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.462068] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.462290] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.462436] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.462492] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.462714] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.462714] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.462819] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39a21d13-3ed6-45f8-bfde-b892e16df2e1 is going to be updated. [ 655.499071] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.499393] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.499393] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.500199] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.500199] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.510857] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39a21d13-3ed6-45f8-bfde-b892e16df2e1 in Status: IN_PROGRESS for 2s [ 655.552615] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 99423afc-7fd3-4e3d-8a84-f190e0af048f: rpc.has_security_group_logging(os_id): False [ 655.576224] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.576428] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.576501] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.576727] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.576851] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.577107] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.577211] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.577283] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.577501] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.577582] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.577852] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.577958] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.578055] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.578208] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.578288] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.579265] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.579265] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.579265] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.579265] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.579265] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.579265] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 99423afc-7fd3-4e3d-8a84-f190e0af048f is going to be created. [ 655.648964] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.649188] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.649232] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.649419] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.649597] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.666033] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 99423afc-7fd3-4e3d-8a84-f190e0af048f in Status: IN_PROGRESS for 2s [ 655.795558] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5501386c-6d40-4911-b095-561660dd038b in Status: SUCCESS [ 655.796605] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5501386c-6d40-4911-b095-561660dd038b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.516505] env[65065]: INFO networking_nsxv3.common.synchronization [None req-b66b71c4-86c9-4f28-8a0e-ab7f83f26bfc None None] Enqueued Resource ID: 6c328f15-1254-4dd4-8494-e16d75b9dacd with Priority: HIGHEST for action port [ 657.517667] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c328f15-1254-4dd4-8494-e16d75b9dacd with Priority: HIGHEST for action port [ 657.518078] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-6c328f15-1254-4dd4-8494-e16d75b9dacd taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.518214] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6c328f15-1254-4dd4-8494-e16d75b9dacd" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.518289] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6c328f15-1254-4dd4-8494-e16d75b9dacd" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.519471] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6c328f15-1254-4dd4-8494-e16d75b9dacd" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.519471] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6c328f15-1254-4dd4-8494-e16d75b9dacd',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.530049] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39a21d13-3ed6-45f8-bfde-b892e16df2e1 in Status: SUCCESS [ 657.530231] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39a21d13-3ed6-45f8-bfde-b892e16df2e1 deletion is rescheduled due to dependency. [ 657.530351] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39a21d13-3ed6-45f8-bfde-b892e16df2e1" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.685890] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 99423afc-7fd3-4e3d-8a84-f190e0af048f in Status: SUCCESS [ 657.685890] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.023224] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6c328f15-1254-4dd4-8494-e16d75b9dacd [ 658.024636] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.024636] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.024636] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.025906] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.025906] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.025906] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6c328f15-1254-4dd4-8494-e16d75b9dacd already deleted. [ 658.025906] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6c328f15-1254-4dd4-8494-e16d75b9dacd" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.817334] env[65065]: INFO networking_nsxv3.common.synchronization [None req-aaf1a1db-872a-44a2-9a7c-cc33507cc5cb None None] Enqueued Resource ID: 26334387-527a-40ab-8c04-af46e2d7002d with Priority: HIGHEST for action port [ 659.817334] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26334387-527a-40ab-8c04-af46e2d7002d with Priority: HIGHEST for action port [ 659.817334] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-26334387-527a-40ab-8c04-af46e2d7002d taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.817334] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-26334387-527a-40ab-8c04-af46e2d7002d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.817334] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-26334387-527a-40ab-8c04-af46e2d7002d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.817334] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-26334387-527a-40ab-8c04-af46e2d7002d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.817334] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('26334387-527a-40ab-8c04-af46e2d7002d',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.901480] env[65065]: INFO networking_nsxv3.common.synchronization [req-c32ebaed-d230-44e4-a3aa-afae5f7b75d4 req-e95c5b61-ba92-40e2-8500-7b2fda1f7768 tempest-ServerActionsTestOtherB-1640131964 tempest-ServerActionsTestOtherB-1640131964-project-member] Enqueued Resource ID: b95b4f27-41f6-4a01-a1aa-aa16348ad807 with Priority: HIGHEST for action security_group_members [ 659.901480] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b95b4f27-41f6-4a01-a1aa-aa16348ad807 with Priority: HIGHEST for action security_group_members [ 659.901480] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-b95b4f27-41f6-4a01-a1aa-aa16348ad807 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.901749] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b95b4f27-41f6-4a01-a1aa-aa16348ad807" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.901850] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b95b4f27-41f6-4a01-a1aa-aa16348ad807" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.902145] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b95b4f27-41f6-4a01-a1aa-aa16348ad807" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.902357] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.902501] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.902597] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.902890] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.903911] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.903911] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b95b4f27-41f6-4a01-a1aa-aa16348ad807',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.322099] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 26334387-527a-40ab-8c04-af46e2d7002d [ 660.322326] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.322458] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.322526] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.322788] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.322969] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.322969] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:26334387-527a-40ab-8c04-af46e2d7002d already deleted. [ 660.322969] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-26334387-527a-40ab-8c04-af46e2d7002d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.405510] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.405680] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.405680] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.405831] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.405921] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.406134] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.406233] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.406288] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.406438] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.406511] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.406591] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b95b4f27-41f6-4a01-a1aa-aa16348ad807 already deleted. [ 660.406668] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b95b4f27-41f6-4a01-a1aa-aa16348ad807" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.605361] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock network-8 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.605563] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "network-8" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.605673] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "network-8" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.605993] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "network-8" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.606279] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.606537] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.606642] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.606883] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.607055] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.607736] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 660.607736] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 660.607736] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 660.607736] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 660.607920] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 660.607920] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 660.607992] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 660.629350] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 660.629499] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 660.934508] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 660.934508] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "network-8" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.934508] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock port-ee62b959-1b77-45ed-97e1-22591f19cb29 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.934508] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "port-ee62b959-1b77-45ed-97e1-22591f19cb29" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.934508] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "port-ee62b959-1b77-45ed-97e1-22591f19cb29" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.934508] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "port-ee62b959-1b77-45ed-97e1-22591f19cb29" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.934508] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ee62b959-1b77-45ed-97e1-22591f19cb29',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.134801] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.135191] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.135329] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.135609] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.135872] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.136124] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Segment Port ee62b959-1b77-45ed-97e1-22591f19cb29 not found, creating... [ 661.136199] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.136343] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.136575] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.136709] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.137068] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.137209] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.137330] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.137856] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.138114] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.138266] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.138340] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Resource: SegmentPort with ID: ee62b959-1b77-45ed-97e1-22591f19cb29 is going to be created. [ 661.161441] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.161441] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.161800] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.161800] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.161970] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.163464] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "port-ee62b959-1b77-45ed-97e1-22591f19cb29" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.592518] env[65065]: INFO networking_nsxv3.common.synchronization [req-ba405355-0d32-4139-9440-036fbce5c8a1 req-47fc33dc-4b4c-43ea-b3e4-fd9eadec2045 tempest-ServersAdminTestJSON-1746807080 tempest-ServersAdminTestJSON-1746807080-project-member] Enqueued Resource ID: ed4053b7-493c-48f8-b82e-b002cbcc3a61 with Priority: HIGHEST for action security_group_members [ 661.593064] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed4053b7-493c-48f8-b82e-b002cbcc3a61 with Priority: HIGHEST for action security_group_members [ 661.593360] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed4053b7-493c-48f8-b82e-b002cbcc3a61 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.593478] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.593545] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.593756] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.593978] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.594094] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.594178] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.594478] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.594478] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.594621] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ed4053b7-493c-48f8-b82e-b002cbcc3a61',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.762290] env[65065]: INFO networking_nsxv3.common.synchronization [None req-57af9c96-a37d-4683-af2a-9e97e1922166 None None] Enqueued Resource ID: 94c8aa84-fce3-4d9b-856e-524c5fe0b0b0 with Priority: HIGHEST for action port [ 661.764236] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94c8aa84-fce3-4d9b-856e-524c5fe0b0b0 with Priority: HIGHEST for action port [ 661.764236] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-94c8aa84-fce3-4d9b-856e-524c5fe0b0b0 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.764236] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-94c8aa84-fce3-4d9b-856e-524c5fe0b0b0" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.764236] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-94c8aa84-fce3-4d9b-856e-524c5fe0b0b0" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.764744] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-94c8aa84-fce3-4d9b-856e-524c5fe0b0b0" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.764744] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('94c8aa84-fce3-4d9b-856e-524c5fe0b0b0',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.955589] env[65065]: INFO networking_nsxv3.common.synchronization [req-c32ebaed-d230-44e4-a3aa-afae5f7b75d4 req-b7812fc3-3a2d-452e-be16-c2b8e5a2f576 service nova] Enqueued Resource ID: b95b4f27-41f6-4a01-a1aa-aa16348ad807 with Priority: HIGHEST for action security_group_rules [ 661.955589] env[65065]: INFO networking_nsxv3.common.synchronization [req-c32ebaed-d230-44e4-a3aa-afae5f7b75d4 req-b7812fc3-3a2d-452e-be16-c2b8e5a2f576 service nova] Enqueued Resource ID: b95b4f27-41f6-4a01-a1aa-aa16348ad807 with Priority: HIGHEST for action security_group_members [ 661.955589] env[65065]: INFO networking_nsxv3.common.synchronization [req-c32ebaed-d230-44e4-a3aa-afae5f7b75d4 req-b7812fc3-3a2d-452e-be16-c2b8e5a2f576 service nova] Enqueued Resource ID: ee62b959-1b77-45ed-97e1-22591f19cb29 with Priority: HIGHEST for action port [ 661.956126] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b95b4f27-41f6-4a01-a1aa-aa16348ad807 with Priority: HIGHEST for action security_group_rules [ 661.956126] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b95b4f27-41f6-4a01-a1aa-aa16348ad807 with Priority: HIGHEST for action security_group_members [ 661.956204] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee62b959-1b77-45ed-97e1-22591f19cb29 with Priority: HIGHEST for action port [ 661.956418] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b95b4f27-41f6-4a01-a1aa-aa16348ad807 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.956533] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b95b4f27-41f6-4a01-a1aa-aa16348ad807" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.956601] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b95b4f27-41f6-4a01-a1aa-aa16348ad807" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.956796] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b95b4f27-41f6-4a01-a1aa-aa16348ad807" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.956869] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b95b4f27-41f6-4a01-a1aa-aa16348ad807',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.957841] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-b95b4f27-41f6-4a01-a1aa-aa16348ad807 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.957903] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b95b4f27-41f6-4a01-a1aa-aa16348ad807" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.957944] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b95b4f27-41f6-4a01-a1aa-aa16348ad807" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.958959] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b95b4f27-41f6-4a01-a1aa-aa16348ad807" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.958959] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.958959] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.958959] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.958959] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.958959] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.958959] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b95b4f27-41f6-4a01-a1aa-aa16348ad807',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.959586] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-ee62b959-1b77-45ed-97e1-22591f19cb29 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.959746] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ee62b959-1b77-45ed-97e1-22591f19cb29" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.959837] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ee62b959-1b77-45ed-97e1-22591f19cb29" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.960123] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ee62b959-1b77-45ed-97e1-22591f19cb29" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.960123] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ee62b959-1b77-45ed-97e1-22591f19cb29',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.238211] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ed4053b7-493c-48f8-b82e-b002cbcc3a61',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.268885] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 94c8aa84-fce3-4d9b-856e-524c5fe0b0b0 [ 662.268885] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.269092] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.269092] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.270030] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.270030] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.270030] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:94c8aa84-fce3-4d9b-856e-524c5fe0b0b0 already deleted. [ 662.270030] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-94c8aa84-fce3-4d9b-856e-524c5fe0b0b0" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.270819] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock network-829 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.270819] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "network-829" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.270819] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "network-829" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.271071] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "network-829" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.271213] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.271399] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.271525] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.275058] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.275278] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.275502] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 662.275660] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 662.275726] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 662.275803] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 662.275904] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 662.276009] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 662.276283] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 662.326114] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 662.326310] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Cache value generated in 0.050 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 662.326310] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 662.326489] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "network-829" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.326838] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock port-ea420e51-8d01-4a2e-89a0-20cc3f7a51f8 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.327021] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "port-ea420e51-8d01-4a2e-89a0-20cc3f7a51f8" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.327139] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "port-ea420e51-8d01-4a2e-89a0-20cc3f7a51f8" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.327553] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "port-ea420e51-8d01-4a2e-89a0-20cc3f7a51f8" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.327711] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ea420e51-8d01-4a2e-89a0-20cc3f7a51f8',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.463425] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-b95b4f27-41f6-4a01-a1aa-aa16348ad807 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.463598] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b95b4f27-41f6-4a01-a1aa-aa16348ad807" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.465110] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b95b4f27-41f6-4a01-a1aa-aa16348ad807',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.466444] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ee62b959-1b77-45ed-97e1-22591f19cb29 with status ACTIVE [ 662.466944] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.466944] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.466944] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.467167] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.467258] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.467398] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.467549] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.467624] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.467837] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.467929] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.468182] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.468293] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.468370] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.468557] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.468650] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.469078] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ee62b959-1b77-45ed-97e1-22591f19cb29 is going to be updated. [ 662.493588] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.493867] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.493867] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.494117] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.494271] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.494459] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ee62b959-1b77-45ed-97e1-22591f19cb29" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.742792] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ed4053b7-493c-48f8-b82e-b002cbcc3a61',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.833381] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.833381] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.833381] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.833381] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.833870] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.834950] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Segment Port ea420e51-8d01-4a2e-89a0-20cc3f7a51f8 not found, creating... [ 662.835882] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.836284] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.836933] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.837817] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.838430] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.839115] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.842222] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.842222] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.842222] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.842222] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.842222] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Resource: SegmentPort with ID: ea420e51-8d01-4a2e-89a0-20cc3f7a51f8 is going to be created. [ 662.862731] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.862731] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.862731] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.862731] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.862731] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.862731] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "port-ea420e51-8d01-4a2e-89a0-20cc3f7a51f8" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.971653] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b95b4f27-41f6-4a01-a1aa-aa16348ad807',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.249252] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.249252] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.249252] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.249252] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.249252] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.249252] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ed4053b7-493c-48f8-b82e-b002cbcc3a61 is going to be updated. [ 663.278043] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.278043] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.278043] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.278043] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.278043] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.290620] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed4053b7-493c-48f8-b82e-b002cbcc3a61 in Status: IN_PROGRESS for 2s [ 663.474382] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.474571] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.474825] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.474825] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.474944] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.474996] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b95b4f27-41f6-4a01-a1aa-aa16348ad807 is going to be created. [ 663.501767] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.501970] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.501970] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.502312] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.502433] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.511810] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b95b4f27-41f6-4a01-a1aa-aa16348ad807 in Status: UNINITIALIZED for 2s [ 663.577090] env[65065]: INFO networking_nsxv3.common.synchronization [req-ba405355-0d32-4139-9440-036fbce5c8a1 req-99586a1b-2651-4c6a-abc6-aaf502b5f728 service nova] Enqueued Resource ID: ed4053b7-493c-48f8-b82e-b002cbcc3a61 with Priority: HIGHEST for action security_group_rules [ 663.577274] env[65065]: INFO networking_nsxv3.common.synchronization [req-ba405355-0d32-4139-9440-036fbce5c8a1 req-99586a1b-2651-4c6a-abc6-aaf502b5f728 service nova] Enqueued Resource ID: ed4053b7-493c-48f8-b82e-b002cbcc3a61 with Priority: HIGHEST for action security_group_members [ 663.577511] env[65065]: INFO networking_nsxv3.common.synchronization [req-ba405355-0d32-4139-9440-036fbce5c8a1 req-99586a1b-2651-4c6a-abc6-aaf502b5f728 service nova] Enqueued Resource ID: ea420e51-8d01-4a2e-89a0-20cc3f7a51f8 with Priority: HIGHEST for action port [ 663.577755] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed4053b7-493c-48f8-b82e-b002cbcc3a61 with Priority: HIGHEST for action security_group_rules [ 663.577921] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed4053b7-493c-48f8-b82e-b002cbcc3a61 with Priority: HIGHEST for action security_group_members [ 663.578019] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea420e51-8d01-4a2e-89a0-20cc3f7a51f8 with Priority: HIGHEST for action port [ 663.578616] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ed4053b7-493c-48f8-b82e-b002cbcc3a61 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.578683] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.578723] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.578894] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.578993] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ed4053b7-493c-48f8-b82e-b002cbcc3a61',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.579800] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed4053b7-493c-48f8-b82e-b002cbcc3a61 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.579903] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.580097] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-ea420e51-8d01-4a2e-89a0-20cc3f7a51f8 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.580178] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ea420e51-8d01-4a2e-89a0-20cc3f7a51f8" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.580272] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ea420e51-8d01-4a2e-89a0-20cc3f7a51f8" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.580396] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ea420e51-8d01-4a2e-89a0-20cc3f7a51f8" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.580465] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ea420e51-8d01-4a2e-89a0-20cc3f7a51f8',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.082314] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed4053b7-493c-48f8-b82e-b002cbcc3a61 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.082630] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.082630] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ea420e51-8d01-4a2e-89a0-20cc3f7a51f8 with status ACTIVE [ 664.082797] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.082901] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.082990] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.083216] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.083320] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.083487] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.083574] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.083618] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.083892] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.083892] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.083997] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.084296] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.084296] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.084296] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.084419] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.084454] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ea420e51-8d01-4a2e-89a0-20cc3f7a51f8 is going to be updated. [ 664.112645] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.112832] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.112917] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.113192] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.113374] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.113547] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ea420e51-8d01-4a2e-89a0-20cc3f7a51f8" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.301317] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed4053b7-493c-48f8-b82e-b002cbcc3a61 in Status: SUCCESS [ 665.301707] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.303197] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.303197] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.304748] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.304748] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.304748] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.304916] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.304916] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.307301] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ed4053b7-493c-48f8-b82e-b002cbcc3a61',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.310311] env[65065]: INFO networking_nsxv3.common.synchronization [None req-e4124b69-aadb-4394-9e18-d6ab7a013885 tempest-ServersTestBootFromVolume-1803684170 tempest-ServersTestBootFromVolume-1803684170-project-member] Enqueued Resource ID: adad9983-8e2e-4bac-8155-8a076b03abc3 with Priority: HIGHEST for action security_group_rules [ 665.313721] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adad9983-8e2e-4bac-8155-8a076b03abc3 with Priority: HIGHEST for action security_group_rules [ 665.314108] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-adad9983-8e2e-4bac-8155-8a076b03abc3 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.314277] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-adad9983-8e2e-4bac-8155-8a076b03abc3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.314351] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-adad9983-8e2e-4bac-8155-8a076b03abc3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.314628] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-adad9983-8e2e-4bac-8155-8a076b03abc3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.314707] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('adad9983-8e2e-4bac-8155-8a076b03abc3',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.522885] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b95b4f27-41f6-4a01-a1aa-aa16348ad807 in Status: SUCCESS [ 665.522885] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b95b4f27-41f6-4a01-a1aa-aa16348ad807" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.523135] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b95b4f27-41f6-4a01-a1aa-aa16348ad807" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.524822] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b95b4f27-41f6-4a01-a1aa-aa16348ad807" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.524822] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.524822] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.524822] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.524822] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.524822] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.524822] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b95b4f27-41f6-4a01-a1aa-aa16348ad807" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.524822] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b95b4f27-41f6-4a01-a1aa-aa16348ad807',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.554545] env[65065]: INFO networking_nsxv3.common.synchronization [None req-dc7259d3-8672-488a-a787-a56a1e85f243 tempest-ServersTestBootFromVolume-1803684170 tempest-ServersTestBootFromVolume-1803684170-project-member] Enqueued Resource ID: adad9983-8e2e-4bac-8155-8a076b03abc3 with Priority: HIGHEST for action security_group_rules [ 665.556687] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adad9983-8e2e-4bac-8155-8a076b03abc3 with Priority: HIGHEST for action security_group_rules [ 665.557869] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-adad9983-8e2e-4bac-8155-8a076b03abc3 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.557869] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-adad9983-8e2e-4bac-8155-8a076b03abc3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.748775] env[65065]: INFO networking_nsxv3.common.synchronization [req-e43305ef-d897-4bc9-86c9-21901e9b95d4 req-b4dccf3e-2f54-4df5-bc5c-49c6e0187d63 tempest-SecurityGroupsTestJSON-312946932 tempest-SecurityGroupsTestJSON-312946932-project-member] Enqueued Resource ID: f3805be6-3069-4624-897e-f4bf1dc6cd31 with Priority: HIGHEST for action security_group_members [ 665.748940] env[65065]: INFO networking_nsxv3.common.synchronization [req-e43305ef-d897-4bc9-86c9-21901e9b95d4 req-b4dccf3e-2f54-4df5-bc5c-49c6e0187d63 tempest-SecurityGroupsTestJSON-312946932 tempest-SecurityGroupsTestJSON-312946932-project-member] Enqueued Resource ID: 99423afc-7fd3-4e3d-8a84-f190e0af048f with Priority: HIGHEST for action security_group_members [ 665.749489] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3805be6-3069-4624-897e-f4bf1dc6cd31 with Priority: HIGHEST for action security_group_members [ 665.751060] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99423afc-7fd3-4e3d-8a84-f190e0af048f with Priority: HIGHEST for action security_group_members [ 665.751461] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3805be6-3069-4624-897e-f4bf1dc6cd31 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.751616] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3805be6-3069-4624-897e-f4bf1dc6cd31" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.751678] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3805be6-3069-4624-897e-f4bf1dc6cd31" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.751985] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3805be6-3069-4624-897e-f4bf1dc6cd31" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.752132] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.752298] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.752298] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.752495] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.752566] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.752641] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3805be6-3069-4624-897e-f4bf1dc6cd31',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.753920] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-99423afc-7fd3-4e3d-8a84-f190e0af048f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.753920] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.753920] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.753920] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.754224] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.754224] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.754224] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.755037] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.755037] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.755037] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('99423afc-7fd3-4e3d-8a84-f190e0af048f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.813064] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ed4053b7-493c-48f8-b82e-b002cbcc3a61',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.817588] env[65065]: INFO networking_nsxv3.common.synchronization [req-e43305ef-d897-4bc9-86c9-21901e9b95d4 req-b4dccf3e-2f54-4df5-bc5c-49c6e0187d63 tempest-SecurityGroupsTestJSON-312946932 tempest-SecurityGroupsTestJSON-312946932-project-member] Enqueued Resource ID: 99423afc-7fd3-4e3d-8a84-f190e0af048f with Priority: HIGHEST for action security_group_rules [ 665.817588] env[65065]: INFO networking_nsxv3.common.synchronization [req-e43305ef-d897-4bc9-86c9-21901e9b95d4 req-b4dccf3e-2f54-4df5-bc5c-49c6e0187d63 tempest-SecurityGroupsTestJSON-312946932 tempest-SecurityGroupsTestJSON-312946932-project-member] Enqueued Resource ID: 99423afc-7fd3-4e3d-8a84-f190e0af048f with Priority: HIGHEST for action security_group_members [ 665.817683] env[65065]: INFO networking_nsxv3.common.synchronization [req-e43305ef-d897-4bc9-86c9-21901e9b95d4 req-b4dccf3e-2f54-4df5-bc5c-49c6e0187d63 tempest-SecurityGroupsTestJSON-312946932 tempest-SecurityGroupsTestJSON-312946932-project-member] Enqueued Resource ID: f3805be6-3069-4624-897e-f4bf1dc6cd31 with Priority: HIGHEST for action security_group_rules [ 665.817863] env[65065]: INFO networking_nsxv3.common.synchronization [req-e43305ef-d897-4bc9-86c9-21901e9b95d4 req-b4dccf3e-2f54-4df5-bc5c-49c6e0187d63 tempest-SecurityGroupsTestJSON-312946932 tempest-SecurityGroupsTestJSON-312946932-project-member] Enqueued Resource ID: f3805be6-3069-4624-897e-f4bf1dc6cd31 with Priority: HIGHEST for action security_group_members [ 665.819988] env[65065]: INFO networking_nsxv3.common.synchronization [req-e43305ef-d897-4bc9-86c9-21901e9b95d4 req-b4dccf3e-2f54-4df5-bc5c-49c6e0187d63 tempest-SecurityGroupsTestJSON-312946932 tempest-SecurityGroupsTestJSON-312946932-project-member] Enqueued Resource ID: 35664542-e3b2-4aac-b216-ec2d6142eecf with Priority: HIGHEST for action port [ 665.821467] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99423afc-7fd3-4e3d-8a84-f190e0af048f with Priority: HIGHEST for action security_group_rules [ 665.821467] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3805be6-3069-4624-897e-f4bf1dc6cd31 with Priority: HIGHEST for action security_group_rules [ 665.821467] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35664542-e3b2-4aac-b216-ec2d6142eecf with Priority: HIGHEST for action port [ 665.821467] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99423afc-7fd3-4e3d-8a84-f190e0af048f with Priority: HIGHEST for action security_group_members [ 665.821467] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3805be6-3069-4624-897e-f4bf1dc6cd31 with Priority: HIGHEST for action security_group_members [ 665.824284] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-99423afc-7fd3-4e3d-8a84-f190e0af048f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.824284] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.824284] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.824284] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.824284] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('99423afc-7fd3-4e3d-8a84-f190e0af048f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.824284] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f3805be6-3069-4624-897e-f4bf1dc6cd31 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.824284] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f3805be6-3069-4624-897e-f4bf1dc6cd31" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.824284] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f3805be6-3069-4624-897e-f4bf1dc6cd31" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.824284] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f3805be6-3069-4624-897e-f4bf1dc6cd31" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.824284] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f3805be6-3069-4624-897e-f4bf1dc6cd31',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.824709] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-35664542-e3b2-4aac-b216-ec2d6142eecf taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.824709] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-35664542-e3b2-4aac-b216-ec2d6142eecf" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.824783] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-35664542-e3b2-4aac-b216-ec2d6142eecf" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.826229] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-35664542-e3b2-4aac-b216-ec2d6142eecf" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.826229] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('35664542-e3b2-4aac-b216-ec2d6142eecf',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.828215] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-99423afc-7fd3-4e3d-8a84-f190e0af048f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.828215] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.828215] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3805be6-3069-4624-897e-f4bf1dc6cd31 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.828215] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3805be6-3069-4624-897e-f4bf1dc6cd31" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.848322] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.848550] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.848550] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.848935] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.848935] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.849190] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: adad9983-8e2e-4bac-8155-8a076b03abc3 already deleted. [ 665.849190] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-adad9983-8e2e-4bac-8155-8a076b03abc3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.849541] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-adad9983-8e2e-4bac-8155-8a076b03abc3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.849727] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-adad9983-8e2e-4bac-8155-8a076b03abc3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.849814] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('adad9983-8e2e-4bac-8155-8a076b03abc3',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.028202] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b95b4f27-41f6-4a01-a1aa-aa16348ad807',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.256682] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f3805be6-3069-4624-897e-f4bf1dc6cd31',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.261846] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('99423afc-7fd3-4e3d-8a84-f190e0af048f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.320792] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ed4053b7-493c-48f8-b82e-b002cbcc3a61',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.329857] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-99423afc-7fd3-4e3d-8a84-f190e0af048f taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.329993] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.330365] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3805be6-3069-4624-897e-f4bf1dc6cd31 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.330365] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3805be6-3069-4624-897e-f4bf1dc6cd31" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.330365] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 35664542-e3b2-4aac-b216-ec2d6142eecf with status ACTIVE [ 666.330831] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.330888] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.330929] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.331159] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.331241] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.331404] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.331831] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.331831] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.331831] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.332100] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.332100] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.332255] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.332255] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.332411] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.332411] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.332538] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 35664542-e3b2-4aac-b216-ec2d6142eecf is going to be updated. [ 666.355371] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.355785] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.355872] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.359021] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.359021] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.359021] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-35664542-e3b2-4aac-b216-ec2d6142eecf" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.372480] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.372640] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.372717] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.373324] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.373324] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.373324] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: adad9983-8e2e-4bac-8155-8a076b03abc3 already deleted. [ 666.373324] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-adad9983-8e2e-4bac-8155-8a076b03abc3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.471078] env[65065]: INFO networking_nsxv3.common.synchronization [req-082beace-fe53-4f9e-a621-105b1d287bcb req-1eb0555a-522d-4cd3-905d-cb9f92d1b68d tempest-ServerDiskConfigTestJSON-975440465 tempest-ServerDiskConfigTestJSON-975440465-project-member] Enqueued Resource ID: ffd44fac-c762-408c-862b-ccea34e00947 with Priority: HIGHEST for action security_group_members [ 666.471888] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ffd44fac-c762-408c-862b-ccea34e00947 with Priority: HIGHEST for action security_group_members [ 666.472486] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-ffd44fac-c762-408c-862b-ccea34e00947 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.472614] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.472680] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.472944] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.473861] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.473861] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.474009] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.474168] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.474260] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.474367] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ffd44fac-c762-408c-862b-ccea34e00947',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.532724] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b95b4f27-41f6-4a01-a1aa-aa16348ad807: rpc.has_security_group_logging(os_id): False [ 666.554157] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.554157] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.554157] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.554157] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.554157] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.554157] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.554157] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.554157] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.554157] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.554157] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.554157] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b95b4f27-41f6-4a01-a1aa-aa16348ad807 is going to be created. [ 666.630260] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.630653] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.630745] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.631370] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.631370] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.648324] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b95b4f27-41f6-4a01-a1aa-aa16348ad807 in Status: IN_PROGRESS for 2s [ 666.762279] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f3805be6-3069-4624-897e-f4bf1dc6cd31',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.763943] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('99423afc-7fd3-4e3d-8a84-f190e0af048f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.824816] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.826377] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.826377] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.826377] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.826377] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.826377] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ed4053b7-493c-48f8-b82e-b002cbcc3a61 is going to be updated. [ 666.858276] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.858424] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.858586] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.858834] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.858987] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.871814] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed4053b7-493c-48f8-b82e-b002cbcc3a61 in Status: IN_PROGRESS for 2s [ 666.937483] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock network-34 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.941524] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "network-34" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.941524] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "network-34" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.941524] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "network-34" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.941524] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.941524] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.941524] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.941524] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.941524] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.941524] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 666.941524] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 666.941524] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 666.941524] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 666.941524] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 666.941524] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 666.941524] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 666.964692] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 666.965269] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 666.965269] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 666.965269] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "network-34" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.965489] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock port-e64677a5-1915-49b9-ac80-18e0e67b753f taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.965688] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "port-e64677a5-1915-49b9-ac80-18e0e67b753f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.965765] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "port-e64677a5-1915-49b9-ac80-18e0e67b753f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.966211] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "port-e64677a5-1915-49b9-ac80-18e0e67b753f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.966313] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e64677a5-1915-49b9-ac80-18e0e67b753f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.976788] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.976788] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.976788] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.978523] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.978523] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.978523] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.978523] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.978523] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.978523] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.978523] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.978523] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ffd44fac-c762-408c-862b-ccea34e00947 already deleted. [ 666.978523] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.265335] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.265494] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.265494] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.265736] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.265803] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.266112] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3805be6-3069-4624-897e-f4bf1dc6cd31 is going to be created. [ 667.267782] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.267782] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.267782] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.267782] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.267782] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.268051] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99423afc-7fd3-4e3d-8a84-f190e0af048f is going to be updated. [ 667.316331] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.316511] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.316561] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.316832] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.317040] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.321072] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.321362] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.321415] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.321681] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.321893] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.330023] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3805be6-3069-4624-897e-f4bf1dc6cd31 in Status: UNINITIALIZED for 2s [ 667.332113] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99423afc-7fd3-4e3d-8a84-f190e0af048f in Status: IN_PROGRESS for 2s [ 667.469577] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.469879] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.470038] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.470332] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.470492] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.470625] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Segment Port e64677a5-1915-49b9-ac80-18e0e67b753f not found, creating... [ 667.470892] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.471361] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.471361] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.471535] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.471712] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.472016] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.472179] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.472291] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.472504] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.472629] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.473219] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Resource: SegmentPort with ID: e64677a5-1915-49b9-ac80-18e0e67b753f is going to be created. [ 667.496281] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.496512] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.496630] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.497049] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.497173] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.497388] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "port-e64677a5-1915-49b9-ac80-18e0e67b753f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.207539] env[65065]: INFO networking_nsxv3.common.synchronization [req-082beace-fe53-4f9e-a621-105b1d287bcb req-6fed3ff0-3dab-44bf-85af-ff6282c8d472 service nova] Enqueued Resource ID: ffd44fac-c762-408c-862b-ccea34e00947 with Priority: HIGHEST for action security_group_rules [ 668.207735] env[65065]: INFO networking_nsxv3.common.synchronization [req-082beace-fe53-4f9e-a621-105b1d287bcb req-6fed3ff0-3dab-44bf-85af-ff6282c8d472 service nova] Enqueued Resource ID: ffd44fac-c762-408c-862b-ccea34e00947 with Priority: HIGHEST for action security_group_members [ 668.207869] env[65065]: INFO networking_nsxv3.common.synchronization [req-082beace-fe53-4f9e-a621-105b1d287bcb req-6fed3ff0-3dab-44bf-85af-ff6282c8d472 service nova] Enqueued Resource ID: e64677a5-1915-49b9-ac80-18e0e67b753f with Priority: HIGHEST for action port [ 668.208702] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ffd44fac-c762-408c-862b-ccea34e00947 with Priority: HIGHEST for action security_group_rules [ 668.208872] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ffd44fac-c762-408c-862b-ccea34e00947 with Priority: HIGHEST for action security_group_members [ 668.209151] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e64677a5-1915-49b9-ac80-18e0e67b753f with Priority: HIGHEST for action port [ 668.209489] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ffd44fac-c762-408c-862b-ccea34e00947 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.209617] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.209683] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.210232] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.213026] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ffd44fac-c762-408c-862b-ccea34e00947',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.213026] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-ffd44fac-c762-408c-862b-ccea34e00947 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.213026] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.213593] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.213848] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.214378] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.214575] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.214623] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.215266] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.215853] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.216038] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ffd44fac-c762-408c-862b-ccea34e00947',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.221454] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-e64677a5-1915-49b9-ac80-18e0e67b753f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.221777] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e64677a5-1915-49b9-ac80-18e0e67b753f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.221777] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e64677a5-1915-49b9-ac80-18e0e67b753f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.221908] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e64677a5-1915-49b9-ac80-18e0e67b753f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.221993] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e64677a5-1915-49b9-ac80-18e0e67b753f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.671041] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b95b4f27-41f6-4a01-a1aa-aa16348ad807 in Status: SUCCESS [ 668.671041] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b95b4f27-41f6-4a01-a1aa-aa16348ad807" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.728590] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ffd44fac-c762-408c-862b-ccea34e00947',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.728590] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-ffd44fac-c762-408c-862b-ccea34e00947 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.728590] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.728590] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e64677a5-1915-49b9-ac80-18e0e67b753f with status ACTIVE [ 668.728590] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.728590] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.728590] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.728590] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.728590] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.729042] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.729042] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.729042] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.729267] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.729267] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.729332] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.729478] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.729478] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.729595] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.729698] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.729751] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e64677a5-1915-49b9-ac80-18e0e67b753f is going to be updated. [ 668.756939] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.756939] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.756939] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.757390] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.757634] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.757872] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e64677a5-1915-49b9-ac80-18e0e67b753f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.889127] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed4053b7-493c-48f8-b82e-b002cbcc3a61 in Status: SUCCESS [ 668.889848] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.890368] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.891632] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.891632] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.891632] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.891632] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.892292] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.892810] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.892810] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.892810] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ed4053b7-493c-48f8-b82e-b002cbcc3a61',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.965839] env[65065]: INFO networking_nsxv3.common.synchronization [req-7f1e0828-39ad-4b53-89d1-9d474188d834 req-8a4993fc-0655-48da-b035-f37a42aafc91 tempest-SecurityGroupsTestJSON-312946932 tempest-SecurityGroupsTestJSON-312946932-project-member] Enqueued Resource ID: f3805be6-3069-4624-897e-f4bf1dc6cd31 with Priority: HIGHEST for action security_group_members [ 668.966043] env[65065]: INFO networking_nsxv3.common.synchronization [req-7f1e0828-39ad-4b53-89d1-9d474188d834 req-8a4993fc-0655-48da-b035-f37a42aafc91 tempest-SecurityGroupsTestJSON-312946932 tempest-SecurityGroupsTestJSON-312946932-project-member] Enqueued Resource ID: 99423afc-7fd3-4e3d-8a84-f190e0af048f with Priority: HIGHEST for action security_group_members [ 668.966208] env[65065]: INFO networking_nsxv3.common.synchronization [req-7f1e0828-39ad-4b53-89d1-9d474188d834 req-8a4993fc-0655-48da-b035-f37a42aafc91 tempest-SecurityGroupsTestJSON-312946932 tempest-SecurityGroupsTestJSON-312946932-project-member] Enqueued Resource ID: c16acdbe-d600-40de-b3d9-384201f1e513 with Priority: HIGHEST for action security_group_members [ 668.968041] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3805be6-3069-4624-897e-f4bf1dc6cd31 with Priority: HIGHEST for action security_group_members [ 668.968041] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99423afc-7fd3-4e3d-8a84-f190e0af048f with Priority: HIGHEST for action security_group_members [ 668.968041] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c16acdbe-d600-40de-b3d9-384201f1e513 with Priority: HIGHEST for action security_group_members [ 668.968041] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3805be6-3069-4624-897e-f4bf1dc6cd31 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.968041] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3805be6-3069-4624-897e-f4bf1dc6cd31" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.968365] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-99423afc-7fd3-4e3d-8a84-f190e0af048f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.968365] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.968559] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-c16acdbe-d600-40de-b3d9-384201f1e513 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.968734] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c16acdbe-d600-40de-b3d9-384201f1e513" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.968734] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c16acdbe-d600-40de-b3d9-384201f1e513" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.969234] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c16acdbe-d600-40de-b3d9-384201f1e513" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.969234] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.969372] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.970685] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.970685] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.970685] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.970685] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c16acdbe-d600-40de-b3d9-384201f1e513',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.049013] env[65065]: INFO networking_nsxv3.common.synchronization [req-7f1e0828-39ad-4b53-89d1-9d474188d834 req-8a4993fc-0655-48da-b035-f37a42aafc91 tempest-SecurityGroupsTestJSON-312946932 tempest-SecurityGroupsTestJSON-312946932-project-member] Enqueued Resource ID: 99423afc-7fd3-4e3d-8a84-f190e0af048f with Priority: HIGHEST for action security_group_rules [ 669.049013] env[65065]: INFO networking_nsxv3.common.synchronization [req-7f1e0828-39ad-4b53-89d1-9d474188d834 req-8a4993fc-0655-48da-b035-f37a42aafc91 tempest-SecurityGroupsTestJSON-312946932 tempest-SecurityGroupsTestJSON-312946932-project-member] Enqueued Resource ID: 99423afc-7fd3-4e3d-8a84-f190e0af048f with Priority: HIGHEST for action security_group_members [ 669.049230] env[65065]: INFO networking_nsxv3.common.synchronization [req-7f1e0828-39ad-4b53-89d1-9d474188d834 req-8a4993fc-0655-48da-b035-f37a42aafc91 tempest-SecurityGroupsTestJSON-312946932 tempest-SecurityGroupsTestJSON-312946932-project-member] Enqueued Resource ID: c16acdbe-d600-40de-b3d9-384201f1e513 with Priority: HIGHEST for action security_group_rules [ 669.049411] env[65065]: INFO networking_nsxv3.common.synchronization [req-7f1e0828-39ad-4b53-89d1-9d474188d834 req-8a4993fc-0655-48da-b035-f37a42aafc91 tempest-SecurityGroupsTestJSON-312946932 tempest-SecurityGroupsTestJSON-312946932-project-member] Enqueued Resource ID: c16acdbe-d600-40de-b3d9-384201f1e513 with Priority: HIGHEST for action security_group_members [ 669.049587] env[65065]: INFO networking_nsxv3.common.synchronization [req-7f1e0828-39ad-4b53-89d1-9d474188d834 req-8a4993fc-0655-48da-b035-f37a42aafc91 tempest-SecurityGroupsTestJSON-312946932 tempest-SecurityGroupsTestJSON-312946932-project-member] Enqueued Resource ID: f3805be6-3069-4624-897e-f4bf1dc6cd31 with Priority: HIGHEST for action security_group_rules [ 669.049745] env[65065]: INFO networking_nsxv3.common.synchronization [req-7f1e0828-39ad-4b53-89d1-9d474188d834 req-8a4993fc-0655-48da-b035-f37a42aafc91 tempest-SecurityGroupsTestJSON-312946932 tempest-SecurityGroupsTestJSON-312946932-project-member] Enqueued Resource ID: f3805be6-3069-4624-897e-f4bf1dc6cd31 with Priority: HIGHEST for action security_group_members [ 669.050205] env[65065]: INFO networking_nsxv3.common.synchronization [req-7f1e0828-39ad-4b53-89d1-9d474188d834 req-8a4993fc-0655-48da-b035-f37a42aafc91 tempest-SecurityGroupsTestJSON-312946932 tempest-SecurityGroupsTestJSON-312946932-project-member] Enqueued Resource ID: 35664542-e3b2-4aac-b216-ec2d6142eecf with Priority: HIGHEST for action port [ 669.053255] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99423afc-7fd3-4e3d-8a84-f190e0af048f with Priority: HIGHEST for action security_group_rules [ 669.053458] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c16acdbe-d600-40de-b3d9-384201f1e513 with Priority: HIGHEST for action security_group_rules [ 669.053725] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3805be6-3069-4624-897e-f4bf1dc6cd31 with Priority: HIGHEST for action security_group_members [ 669.053846] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35664542-e3b2-4aac-b216-ec2d6142eecf with Priority: HIGHEST for action port [ 669.057022] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3805be6-3069-4624-897e-f4bf1dc6cd31 with Priority: HIGHEST for action security_group_rules [ 669.057022] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99423afc-7fd3-4e3d-8a84-f190e0af048f with Priority: HIGHEST for action security_group_members [ 669.057022] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c16acdbe-d600-40de-b3d9-384201f1e513 with Priority: HIGHEST for action security_group_members [ 669.057022] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-99423afc-7fd3-4e3d-8a84-f190e0af048f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.057022] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.057022] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c16acdbe-d600-40de-b3d9-384201f1e513 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.057022] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c16acdbe-d600-40de-b3d9-384201f1e513" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.057022] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c16acdbe-d600-40de-b3d9-384201f1e513" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.057022] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c16acdbe-d600-40de-b3d9-384201f1e513" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.057022] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c16acdbe-d600-40de-b3d9-384201f1e513',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.058923] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3805be6-3069-4624-897e-f4bf1dc6cd31 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.058923] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3805be6-3069-4624-897e-f4bf1dc6cd31" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.059062] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-35664542-e3b2-4aac-b216-ec2d6142eecf taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.059062] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-35664542-e3b2-4aac-b216-ec2d6142eecf" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.059175] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-35664542-e3b2-4aac-b216-ec2d6142eecf" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.059355] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-35664542-e3b2-4aac-b216-ec2d6142eecf" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.062685] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('35664542-e3b2-4aac-b216-ec2d6142eecf',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.062685] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f3805be6-3069-4624-897e-f4bf1dc6cd31 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.062685] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f3805be6-3069-4624-897e-f4bf1dc6cd31" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.062685] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-99423afc-7fd3-4e3d-8a84-f190e0af048f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.062685] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.062685] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-c16acdbe-d600-40de-b3d9-384201f1e513 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.062685] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c16acdbe-d600-40de-b3d9-384201f1e513" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.236333] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ffd44fac-c762-408c-862b-ccea34e00947',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.242961] env[65065]: INFO networking_nsxv3.common.synchronization [None req-18527985-468d-45f8-8f26-bec5781a471f None None] Enqueued Resource ID: 42d8e7b5-a1f4-454e-a63f-6c5f473fc481 with Priority: HIGHEST for action port [ 669.244590] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42d8e7b5-a1f4-454e-a63f-6c5f473fc481 with Priority: HIGHEST for action port [ 669.245594] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-42d8e7b5-a1f4-454e-a63f-6c5f473fc481 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.245854] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-42d8e7b5-a1f4-454e-a63f-6c5f473fc481" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.245953] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-42d8e7b5-a1f4-454e-a63f-6c5f473fc481" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.246339] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-42d8e7b5-a1f4-454e-a63f-6c5f473fc481" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.246487] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('42d8e7b5-a1f4-454e-a63f-6c5f473fc481',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.322988] env[65065]: INFO networking_nsxv3.common.synchronization [req-34dda257-a355-4ce5-8541-80a5889ec84d req-0c806b5f-6b3a-4fa8-a49a-9e5e80ef4fab tempest-ServerActionsTestJSON-1279756280 tempest-ServerActionsTestJSON-1279756280-project-member] Enqueued Resource ID: c587345b-51c8-42f7-8a0c-052027c4b18c with Priority: HIGHEST for action security_group_members [ 669.323572] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c587345b-51c8-42f7-8a0c-052027c4b18c with Priority: HIGHEST for action security_group_members [ 669.324343] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-c587345b-51c8-42f7-8a0c-052027c4b18c taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.324543] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c587345b-51c8-42f7-8a0c-052027c4b18c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.326039] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c587345b-51c8-42f7-8a0c-052027c4b18c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.326039] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c587345b-51c8-42f7-8a0c-052027c4b18c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.326039] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.326039] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.326039] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.326039] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.326039] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.326039] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c587345b-51c8-42f7-8a0c-052027c4b18c',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.344163] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99423afc-7fd3-4e3d-8a84-f190e0af048f in Status: SUCCESS [ 669.344609] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.345152] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3805be6-3069-4624-897e-f4bf1dc6cd31 in Status: SUCCESS [ 669.345342] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3805be6-3069-4624-897e-f4bf1dc6cd31" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.345978] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.346183] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.346780] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.347599] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.347599] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.347762] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.347823] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.347961] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('99423afc-7fd3-4e3d-8a84-f190e0af048f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.348834] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3805be6-3069-4624-897e-f4bf1dc6cd31" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.349021] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3805be6-3069-4624-897e-f4bf1dc6cd31" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.349201] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.349322] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.349558] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.349558] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.349683] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.349716] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3805be6-3069-4624-897e-f4bf1dc6cd31',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.397325] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed4053b7-493c-48f8-b82e-b002cbcc3a61 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.397625] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.397717] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.397897] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.398297] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.398488] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.398585] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.399012] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.399012] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.399012] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.399323] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed4053b7-493c-48f8-b82e-b002cbcc3a61 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.399323] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.399323] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.399444] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.399479] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.399606] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.399751] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.399891] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.400030] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.400146] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.400193] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ed4053b7-493c-48f8-b82e-b002cbcc3a61',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.475065] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c16acdbe-d600-40de-b3d9-384201f1e513',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.559189] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-c16acdbe-d600-40de-b3d9-384201f1e513 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.559189] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c16acdbe-d600-40de-b3d9-384201f1e513" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.565100] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 35664542-e3b2-4aac-b216-ec2d6142eecf with status ACTIVE [ 669.565100] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.565100] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.565100] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.565100] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.565100] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.565100] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.565100] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.565100] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.565100] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.565100] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.565100] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.565100] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.565100] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.565100] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.565100] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.565100] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 35664542-e3b2-4aac-b216-ec2d6142eecf is going to be updated. [ 669.610014] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.610014] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.610014] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.610014] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.610014] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.610014] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-35664542-e3b2-4aac-b216-ec2d6142eecf" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.741097] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.741386] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.741386] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.742262] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.742262] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.742262] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ffd44fac-c762-408c-862b-ccea34e00947 is going to be created. [ 669.750009] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 42d8e7b5-a1f4-454e-a63f-6c5f473fc481 [ 669.750292] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.750426] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.750495] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.750717] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.750806] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.750928] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:42d8e7b5-a1f4-454e-a63f-6c5f473fc481 already deleted. [ 669.750979] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-42d8e7b5-a1f4-454e-a63f-6c5f473fc481" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.768531] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.769200] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.769200] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.769200] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.769457] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.791995] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ffd44fac-c762-408c-862b-ccea34e00947 in Status: UNINITIALIZED for 2s [ 669.828660] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.828848] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.830171] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.830171] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.830171] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.830171] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.830171] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.830171] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.830171] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.830171] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.830171] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c587345b-51c8-42f7-8a0c-052027c4b18c already deleted. [ 669.830171] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c587345b-51c8-42f7-8a0c-052027c4b18c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.853035] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('99423afc-7fd3-4e3d-8a84-f190e0af048f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.854434] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f3805be6-3069-4624-897e-f4bf1dc6cd31',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.901821] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ed4053b7-493c-48f8-b82e-b002cbcc3a61: rpc.has_security_group_logging(os_id): False [ 669.907419] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock network-502 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.907643] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "network-502" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.907763] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "network-502" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.908240] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "network-502" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.908586] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.908870] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.908996] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.909291] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.909435] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.909649] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 669.909761] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 669.909864] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 669.909964] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 669.910152] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 669.912085] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 669.912085] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 669.924235] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.924414] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.924527] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.924637] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.924724] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.924970] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.925178] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.925244] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.925463] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.925603] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.927017] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.927017] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.927017] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.927017] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.927017] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.927017] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.927017] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.927017] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.927017] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.927017] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.927017] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ed4053b7-493c-48f8-b82e-b002cbcc3a61 is going to be updated. [ 669.938028] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 669.938028] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 669.938028] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 669.938028] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "network-502" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.938028] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock port-b493fe8a-b793-4dbd-9ff7-68bdcec6bde3 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.938028] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "port-b493fe8a-b793-4dbd-9ff7-68bdcec6bde3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.938028] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "port-b493fe8a-b793-4dbd-9ff7-68bdcec6bde3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.940276] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "port-b493fe8a-b793-4dbd-9ff7-68bdcec6bde3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.940454] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b493fe8a-b793-4dbd-9ff7-68bdcec6bde3',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.979714] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c16acdbe-d600-40de-b3d9-384201f1e513',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.004675] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.004675] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.004675] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.004953] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.005137] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.029185] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ed4053b7-493c-48f8-b82e-b002cbcc3a61 in Status: IN_PROGRESS for 2s [ 670.355141] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('99423afc-7fd3-4e3d-8a84-f190e0af048f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.356535] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f3805be6-3069-4624-897e-f4bf1dc6cd31',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.443181] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.444144] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.444144] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.444144] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.444144] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.445515] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Segment Port b493fe8a-b793-4dbd-9ff7-68bdcec6bde3 not found, creating... [ 670.445515] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.445515] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.445515] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.445515] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.445515] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.445869] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.446102] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.446227] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.446496] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.446700] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.446909] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Resource: SegmentPort with ID: b493fe8a-b793-4dbd-9ff7-68bdcec6bde3 is going to be created. [ 670.478276] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.478676] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.478864] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.479194] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.479532] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.479859] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "port-b493fe8a-b793-4dbd-9ff7-68bdcec6bde3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.482585] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.482748] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.482943] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.483041] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.483131] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.483227] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c16acdbe-d600-40de-b3d9-384201f1e513 is going to be created. [ 670.524782] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.524977] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.525052] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.525245] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.525835] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.549900] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c16acdbe-d600-40de-b3d9-384201f1e513 in Status: UNINITIALIZED for 2s [ 670.858973] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.862087] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.862087] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.862087] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.862087] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.862087] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99423afc-7fd3-4e3d-8a84-f190e0af048f is going to be updated. [ 670.862087] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.862087] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.862087] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.862087] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.862564] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.862780] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3805be6-3069-4624-897e-f4bf1dc6cd31 is going to be updated. [ 670.898916] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.901438] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.901438] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.901438] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.901438] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.902907] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.903206] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.903404] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.904837] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.904837] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.927639] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99423afc-7fd3-4e3d-8a84-f190e0af048f in Status: IN_PROGRESS for 2s [ 670.927639] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3805be6-3069-4624-897e-f4bf1dc6cd31 in Status: IN_PROGRESS for 2s [ 671.329553] env[65065]: INFO networking_nsxv3.common.synchronization [req-34dda257-a355-4ce5-8541-80a5889ec84d req-73828df0-0121-445b-ab2a-43e812086183 service nova] Enqueued Resource ID: c587345b-51c8-42f7-8a0c-052027c4b18c with Priority: HIGHEST for action security_group_rules [ 671.329553] env[65065]: INFO networking_nsxv3.common.synchronization [req-34dda257-a355-4ce5-8541-80a5889ec84d req-73828df0-0121-445b-ab2a-43e812086183 service nova] Enqueued Resource ID: c587345b-51c8-42f7-8a0c-052027c4b18c with Priority: HIGHEST for action security_group_members [ 671.329715] env[65065]: INFO networking_nsxv3.common.synchronization [req-34dda257-a355-4ce5-8541-80a5889ec84d req-73828df0-0121-445b-ab2a-43e812086183 service nova] Enqueued Resource ID: b493fe8a-b793-4dbd-9ff7-68bdcec6bde3 with Priority: HIGHEST for action port [ 671.331171] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c587345b-51c8-42f7-8a0c-052027c4b18c with Priority: HIGHEST for action security_group_rules [ 671.331171] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c587345b-51c8-42f7-8a0c-052027c4b18c with Priority: HIGHEST for action security_group_members [ 671.331171] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b493fe8a-b793-4dbd-9ff7-68bdcec6bde3 with Priority: HIGHEST for action port [ 671.331510] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c587345b-51c8-42f7-8a0c-052027c4b18c taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.333475] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c587345b-51c8-42f7-8a0c-052027c4b18c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.333475] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c587345b-51c8-42f7-8a0c-052027c4b18c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.333475] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c587345b-51c8-42f7-8a0c-052027c4b18c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.333475] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c587345b-51c8-42f7-8a0c-052027c4b18c',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.333475] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-c587345b-51c8-42f7-8a0c-052027c4b18c taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.333475] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c587345b-51c8-42f7-8a0c-052027c4b18c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.333475] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c587345b-51c8-42f7-8a0c-052027c4b18c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.333992] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c587345b-51c8-42f7-8a0c-052027c4b18c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.333992] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.333992] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.333992] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.334467] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.334852] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.334852] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c587345b-51c8-42f7-8a0c-052027c4b18c',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.336402] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-b493fe8a-b793-4dbd-9ff7-68bdcec6bde3 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.336402] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b493fe8a-b793-4dbd-9ff7-68bdcec6bde3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.336402] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b493fe8a-b793-4dbd-9ff7-68bdcec6bde3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.336402] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b493fe8a-b793-4dbd-9ff7-68bdcec6bde3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.336402] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b493fe8a-b793-4dbd-9ff7-68bdcec6bde3',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.732345] env[65065]: INFO networking_nsxv3.common.synchronization [req-51b2e55b-561b-43db-996b-003fdf900317 req-1529757a-78ef-44bd-9de8-ad491896067f tempest-InstanceActionsNegativeTestJSON-78954398 tempest-InstanceActionsNegativeTestJSON-78954398-project-member] Enqueued Resource ID: 960b9480-1a74-45ed-ba3b-4c9311dd370c with Priority: HIGHEST for action security_group_members [ 671.733206] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 960b9480-1a74-45ed-ba3b-4c9311dd370c with Priority: HIGHEST for action security_group_members [ 671.735149] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-960b9480-1a74-45ed-ba3b-4c9311dd370c taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.735149] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-960b9480-1a74-45ed-ba3b-4c9311dd370c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.735149] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-960b9480-1a74-45ed-ba3b-4c9311dd370c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.735149] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-960b9480-1a74-45ed-ba3b-4c9311dd370c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.736638] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.736638] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.736813] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.736868] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.736958] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.737076] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('960b9480-1a74-45ed-ba3b-4c9311dd370c',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.804573] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ffd44fac-c762-408c-862b-ccea34e00947 in Status: UNINITIALIZED for 4s [ 671.839242] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c587345b-51c8-42f7-8a0c-052027c4b18c',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.845036] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-c587345b-51c8-42f7-8a0c-052027c4b18c taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.845036] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c587345b-51c8-42f7-8a0c-052027c4b18c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.845036] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b493fe8a-b793-4dbd-9ff7-68bdcec6bde3 with status ACTIVE [ 671.845036] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.845036] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.845036] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.845581] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.845581] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.845909] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.845909] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.845909] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.845909] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.846121] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.846370] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.846576] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.846576] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.846655] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.847425] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.847425] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b493fe8a-b793-4dbd-9ff7-68bdcec6bde3 is going to be updated. [ 671.884183] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.884183] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.884183] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.884183] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.885862] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.885862] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b493fe8a-b793-4dbd-9ff7-68bdcec6bde3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.056563] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ed4053b7-493c-48f8-b82e-b002cbcc3a61 in Status: SUCCESS [ 672.056563] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.172091] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock network-859 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.172091] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "network-859" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.172091] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "network-859" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.172091] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "network-859" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.172091] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.172091] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.172091] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.172808] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.173144] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.173577] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 672.173816] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 672.174035] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 672.174239] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 672.174658] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 672.174883] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 672.175180] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 672.185045] env[65065]: INFO networking_nsxv3.common.synchronization [None req-1afdc24b-64c7-4a18-b1d7-734bc6cb52d6 None None] Enqueued Resource ID: 50523489-e7c0-4b56-a798-ff9247352ee9 with Priority: HIGHEST for action port [ 672.185045] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50523489-e7c0-4b56-a798-ff9247352ee9 with Priority: HIGHEST for action port [ 672.185045] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-50523489-e7c0-4b56-a798-ff9247352ee9 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.185045] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-50523489-e7c0-4b56-a798-ff9247352ee9" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.185045] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-50523489-e7c0-4b56-a798-ff9247352ee9" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.186151] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-50523489-e7c0-4b56-a798-ff9247352ee9" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.186455] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('50523489-e7c0-4b56-a798-ff9247352ee9',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.212596] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 672.212785] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Cache value generated in 0.038 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 672.212894] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 672.213142] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "network-859" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.213461] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock port-16003746-0a22-496e-9ef0-5b50cd5fadb7 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.213689] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "port-16003746-0a22-496e-9ef0-5b50cd5fadb7" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.213874] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "port-16003746-0a22-496e-9ef0-5b50cd5fadb7" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.214586] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "port-16003746-0a22-496e-9ef0-5b50cd5fadb7" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.214731] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('16003746-0a22-496e-9ef0-5b50cd5fadb7',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.242044] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.242044] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.242044] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.242044] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.242044] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.242044] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.242044] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.242044] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.242044] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.242044] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.242044] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 960b9480-1a74-45ed-ba3b-4c9311dd370c already deleted. [ 672.242044] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-960b9480-1a74-45ed-ba3b-4c9311dd370c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.344806] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c587345b-51c8-42f7-8a0c-052027c4b18c',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.567019] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c16acdbe-d600-40de-b3d9-384201f1e513 in Status: SUCCESS [ 672.567019] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c16acdbe-d600-40de-b3d9-384201f1e513" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.567019] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c16acdbe-d600-40de-b3d9-384201f1e513" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.567019] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c16acdbe-d600-40de-b3d9-384201f1e513" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.567019] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.567019] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.567019] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.567019] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.567019] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.567019] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c16acdbe-d600-40de-b3d9-384201f1e513',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.689590] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 50523489-e7c0-4b56-a798-ff9247352ee9 [ 672.689869] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.690019] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.690087] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.690322] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.690935] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.690935] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:50523489-e7c0-4b56-a798-ff9247352ee9 already deleted. [ 672.690935] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-50523489-e7c0-4b56-a798-ff9247352ee9" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.718798] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.719035] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.719313] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.719607] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.719702] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.720119] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Segment Port 16003746-0a22-496e-9ef0-5b50cd5fadb7 not found, creating... [ 672.720198] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.720362] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.720492] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.720760] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.720905] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.721260] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.721419] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.721541] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.721795] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.721959] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.722193] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Resource: SegmentPort with ID: 16003746-0a22-496e-9ef0-5b50cd5fadb7 is going to be created. [ 672.746546] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.746875] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.747036] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.747579] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.749056] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.749056] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "port-16003746-0a22-496e-9ef0-5b50cd5fadb7" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.847571] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.847901] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.847901] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.848257] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.848458] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.848569] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c587345b-51c8-42f7-8a0c-052027c4b18c is going to be created. [ 672.887878] env[65065]: INFO networking_nsxv3.common.synchronization [req-70ee4b01-de4b-4ac3-913d-4a88242f94fb req-5d5bc441-b387-4adb-8995-0c8a4c774cbd tempest-DeleteServersAdminTestJSON-854701151 tempest-DeleteServersAdminTestJSON-854701151-project-member] Enqueued Resource ID: 5501386c-6d40-4911-b095-561660dd038b with Priority: HIGHEST for action security_group_members [ 672.887878] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5501386c-6d40-4911-b095-561660dd038b with Priority: HIGHEST for action security_group_members [ 672.888418] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-5501386c-6d40-4911-b095-561660dd038b taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.888597] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5501386c-6d40-4911-b095-561660dd038b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.888672] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5501386c-6d40-4911-b095-561660dd038b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.888940] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5501386c-6d40-4911-b095-561660dd038b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.890364] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.890364] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.890364] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.890364] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.890364] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.890364] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5501386c-6d40-4911-b095-561660dd038b',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.905615] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.905615] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.905615] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.905929] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.906117] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.920622] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c587345b-51c8-42f7-8a0c-052027c4b18c in Status: UNINITIALIZED for 2s [ 672.942932] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3805be6-3069-4624-897e-f4bf1dc6cd31 in Status: SUCCESS [ 672.942932] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3805be6-3069-4624-897e-f4bf1dc6cd31" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.942932] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3805be6-3069-4624-897e-f4bf1dc6cd31" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.943306] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3805be6-3069-4624-897e-f4bf1dc6cd31" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.943475] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.943586] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.943667] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.943822] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.943910] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.944024] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3805be6-3069-4624-897e-f4bf1dc6cd31" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.944167] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f3805be6-3069-4624-897e-f4bf1dc6cd31',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.946160] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99423afc-7fd3-4e3d-8a84-f190e0af048f in Status: SUCCESS [ 672.946404] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.946527] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3805be6-3069-4624-897e-f4bf1dc6cd31" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.946740] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3805be6-3069-4624-897e-f4bf1dc6cd31" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.946907] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.947044] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.947113] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.947304] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.947395] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.947670] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3805be6-3069-4624-897e-f4bf1dc6cd31',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.950367] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.950614] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.951437] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.951437] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.951437] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.951437] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.951663] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.951663] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.951730] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('99423afc-7fd3-4e3d-8a84-f190e0af048f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.955042] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.955325] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.955726] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.956200] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.956376] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.958302] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.958302] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.958302] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('99423afc-7fd3-4e3d-8a84-f190e0af048f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.073130] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c16acdbe-d600-40de-b3d9-384201f1e513',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.392742] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.393027] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.393128] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.393367] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.393500] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.393734] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.393899] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.393966] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.394167] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.394262] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.394446] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5501386c-6d40-4911-b095-561660dd038b is going to be updated. [ 673.431209] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.431466] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.431466] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.431610] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.431749] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.443759] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5501386c-6d40-4911-b095-561660dd038b in Status: IN_PROGRESS for 2s [ 673.451443] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f3805be6-3069-4624-897e-f4bf1dc6cd31',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.455485] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f3805be6-3069-4624-897e-f4bf1dc6cd31',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.457244] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-99423afc-7fd3-4e3d-8a84-f190e0af048f taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.457440] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.460963] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('99423afc-7fd3-4e3d-8a84-f190e0af048f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.543308] env[65065]: INFO networking_nsxv3.common.synchronization [req-51b2e55b-561b-43db-996b-003fdf900317 req-976606ff-a827-44e7-83a9-2576e88029ba service nova] Enqueued Resource ID: 960b9480-1a74-45ed-ba3b-4c9311dd370c with Priority: HIGHEST for action security_group_rules [ 673.543308] env[65065]: INFO networking_nsxv3.common.synchronization [req-51b2e55b-561b-43db-996b-003fdf900317 req-976606ff-a827-44e7-83a9-2576e88029ba service nova] Enqueued Resource ID: 960b9480-1a74-45ed-ba3b-4c9311dd370c with Priority: HIGHEST for action security_group_members [ 673.543308] env[65065]: INFO networking_nsxv3.common.synchronization [req-51b2e55b-561b-43db-996b-003fdf900317 req-976606ff-a827-44e7-83a9-2576e88029ba service nova] Enqueued Resource ID: 16003746-0a22-496e-9ef0-5b50cd5fadb7 with Priority: HIGHEST for action port [ 673.543907] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 960b9480-1a74-45ed-ba3b-4c9311dd370c with Priority: HIGHEST for action security_group_rules [ 673.544282] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 960b9480-1a74-45ed-ba3b-4c9311dd370c with Priority: HIGHEST for action security_group_members [ 673.544541] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16003746-0a22-496e-9ef0-5b50cd5fadb7 with Priority: HIGHEST for action port [ 673.544951] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-960b9480-1a74-45ed-ba3b-4c9311dd370c taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.545321] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-960b9480-1a74-45ed-ba3b-4c9311dd370c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.546164] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-960b9480-1a74-45ed-ba3b-4c9311dd370c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.546634] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-960b9480-1a74-45ed-ba3b-4c9311dd370c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.547257] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('960b9480-1a74-45ed-ba3b-4c9311dd370c',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.549099] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-960b9480-1a74-45ed-ba3b-4c9311dd370c taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.549358] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-960b9480-1a74-45ed-ba3b-4c9311dd370c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.549514] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-960b9480-1a74-45ed-ba3b-4c9311dd370c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.549804] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-960b9480-1a74-45ed-ba3b-4c9311dd370c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.550080] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.551284] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.551284] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.551284] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.551284] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.551284] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('960b9480-1a74-45ed-ba3b-4c9311dd370c',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.552274] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-16003746-0a22-496e-9ef0-5b50cd5fadb7 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.552391] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-16003746-0a22-496e-9ef0-5b50cd5fadb7" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.552460] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-16003746-0a22-496e-9ef0-5b50cd5fadb7" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.552635] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-16003746-0a22-496e-9ef0-5b50cd5fadb7" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.552719] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('16003746-0a22-496e-9ef0-5b50cd5fadb7',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.575315] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c16acdbe-d600-40de-b3d9-384201f1e513',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.816691] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ffd44fac-c762-408c-862b-ccea34e00947 in Status: SUCCESS [ 673.816955] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.817101] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.817326] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.817789] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.817942] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.818038] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.818292] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.818412] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.818528] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.818618] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ffd44fac-c762-408c-862b-ccea34e00947',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.954496] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f3805be6-3069-4624-897e-f4bf1dc6cd31',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.958457] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f3805be6-3069-4624-897e-f4bf1dc6cd31: rpc.has_security_group_logging(os_id): False [ 673.963274] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('99423afc-7fd3-4e3d-8a84-f190e0af048f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.980376] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.980545] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.980601] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.980785] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.980876] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.981102] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.981223] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.981285] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.981403] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.981474] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.981558] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f3805be6-3069-4624-897e-f4bf1dc6cd31 is going to be created. [ 674.051046] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.051245] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.051349] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.051605] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.051854] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.055487] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-960b9480-1a74-45ed-ba3b-4c9311dd370c taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.055695] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-960b9480-1a74-45ed-ba3b-4c9311dd370c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.055778] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('960b9480-1a74-45ed-ba3b-4c9311dd370c',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.057960] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 16003746-0a22-496e-9ef0-5b50cd5fadb7 with status ACTIVE [ 674.057960] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.057960] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.057960] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.058374] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.058374] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.058489] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.058489] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.058615] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.058726] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.058773] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.058940] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.059117] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.059172] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.059480] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.059480] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.059645] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 16003746-0a22-496e-9ef0-5b50cd5fadb7 is going to be updated. [ 674.068044] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f3805be6-3069-4624-897e-f4bf1dc6cd31 in Status: IN_PROGRESS for 2s [ 674.077885] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.078117] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.078283] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.078569] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.078652] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.078815] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c16acdbe-d600-40de-b3d9-384201f1e513 is going to be updated. [ 674.091645] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.091849] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.091893] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.092180] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.092425] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.092529] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-16003746-0a22-496e-9ef0-5b50cd5fadb7" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.114289] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.114500] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.114500] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.114708] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.114845] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.144752] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c16acdbe-d600-40de-b3d9-384201f1e513 in Status: IN_PROGRESS for 2s [ 674.320905] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-ffd44fac-c762-408c-862b-ccea34e00947 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.321172] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.321251] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.321434] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.321627] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.321767] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.321847] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.321995] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.322152] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.322313] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.322464] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-ffd44fac-c762-408c-862b-ccea34e00947 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.322564] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.322741] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.322829] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.322971] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.323091] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.323162] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.323329] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.323416] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.323495] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.323608] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ffd44fac-c762-408c-862b-ccea34e00947',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.457429] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.457429] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.457429] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.457429] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.457429] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.457429] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3805be6-3069-4624-897e-f4bf1dc6cd31 is going to be updated. [ 674.465042] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.465201] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.465201] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.465451] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.465553] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.465653] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99423afc-7fd3-4e3d-8a84-f190e0af048f is going to be updated. [ 674.491376] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.491638] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.491638] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.491827] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.492459] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.494405] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.494571] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.494672] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.494920] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.495120] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.507823] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99423afc-7fd3-4e3d-8a84-f190e0af048f in Status: IN_PROGRESS for 2s [ 674.508648] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3805be6-3069-4624-897e-f4bf1dc6cd31 in Status: IN_PROGRESS for 2s [ 674.558273] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('960b9480-1a74-45ed-ba3b-4c9311dd370c',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.827354] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ffd44fac-c762-408c-862b-ccea34e00947: rpc.has_security_group_logging(os_id): False [ 674.849271] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.849487] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.849600] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.849858] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.849966] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.850203] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.850344] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.850442] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.850662] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.850758] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.852063] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.852063] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.852063] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.852063] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.852063] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.852063] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.852063] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.852063] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.852575] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.852575] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.852575] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ffd44fac-c762-408c-862b-ccea34e00947 is going to be created. [ 674.932513] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c587345b-51c8-42f7-8a0c-052027c4b18c in Status: SUCCESS [ 674.932916] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c587345b-51c8-42f7-8a0c-052027c4b18c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.933294] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c587345b-51c8-42f7-8a0c-052027c4b18c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.933693] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c587345b-51c8-42f7-8a0c-052027c4b18c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.934060] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.934243] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.934388] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.934698] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.934853] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.935021] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c587345b-51c8-42f7-8a0c-052027c4b18c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.935204] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c587345b-51c8-42f7-8a0c-052027c4b18c',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.963265] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.963679] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.963679] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.963821] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.964100] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.979026] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ffd44fac-c762-408c-862b-ccea34e00947 in Status: IN_PROGRESS for 2s [ 675.061376] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.061651] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.061651] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.061949] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.062085] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.062219] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 960b9480-1a74-45ed-ba3b-4c9311dd370c is going to be created. [ 675.092095] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.092315] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.092315] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.092525] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.092785] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.104202] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 960b9480-1a74-45ed-ba3b-4c9311dd370c in Status: UNINITIALIZED for 2s [ 675.438493] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c587345b-51c8-42f7-8a0c-052027c4b18c',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.455106] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5501386c-6d40-4911-b095-561660dd038b in Status: SUCCESS [ 675.455326] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5501386c-6d40-4911-b095-561660dd038b deletion is rescheduled due to dependency. [ 675.455383] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5501386c-6d40-4911-b095-561660dd038b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.941690] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c587345b-51c8-42f7-8a0c-052027c4b18c: rpc.has_security_group_logging(os_id): False [ 675.964577] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.965072] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.965072] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.965072] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.965195] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.965469] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.965579] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.965646] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.965847] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.965952] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.966121] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c587345b-51c8-42f7-8a0c-052027c4b18c is going to be created. [ 676.045495] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.045803] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.045871] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.046087] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.046351] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.059619] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c587345b-51c8-42f7-8a0c-052027c4b18c in Status: IN_PROGRESS for 2s [ 676.088857] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f3805be6-3069-4624-897e-f4bf1dc6cd31 in Status: SUCCESS [ 676.089243] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f3805be6-3069-4624-897e-f4bf1dc6cd31" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.089517] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f3805be6-3069-4624-897e-f4bf1dc6cd31" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.089912] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f3805be6-3069-4624-897e-f4bf1dc6cd31" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.090057] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f3805be6-3069-4624-897e-f4bf1dc6cd31',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.155791] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c16acdbe-d600-40de-b3d9-384201f1e513 in Status: SUCCESS [ 676.156200] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c16acdbe-d600-40de-b3d9-384201f1e513" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.156432] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c16acdbe-d600-40de-b3d9-384201f1e513" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.156734] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c16acdbe-d600-40de-b3d9-384201f1e513" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.157022] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.157265] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.157348] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.157485] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.157676] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.157790] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c16acdbe-d600-40de-b3d9-384201f1e513" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.157902] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c16acdbe-d600-40de-b3d9-384201f1e513',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.518752] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3805be6-3069-4624-897e-f4bf1dc6cd31 in Status: SUCCESS [ 676.518964] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3805be6-3069-4624-897e-f4bf1dc6cd31" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.519145] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3805be6-3069-4624-897e-f4bf1dc6cd31" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.519358] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3805be6-3069-4624-897e-f4bf1dc6cd31" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.519543] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.519655] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.519719] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.519867] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.519944] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.520055] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3805be6-3069-4624-897e-f4bf1dc6cd31',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.521573] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99423afc-7fd3-4e3d-8a84-f190e0af048f in Status: SUCCESS [ 676.521695] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.521836] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.522011] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.522174] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.522276] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.522418] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.522466] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.522548] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.522633] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('99423afc-7fd3-4e3d-8a84-f190e0af048f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.592340] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3805be6-3069-4624-897e-f4bf1dc6cd31 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.592576] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3805be6-3069-4624-897e-f4bf1dc6cd31" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.660759] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c16acdbe-d600-40de-b3d9-384201f1e513',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.992704] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ffd44fac-c762-408c-862b-ccea34e00947 in Status: SUCCESS [ 676.993081] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.024244] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f3805be6-3069-4624-897e-f4bf1dc6cd31',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.025675] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('99423afc-7fd3-4e3d-8a84-f190e0af048f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.128764] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 960b9480-1a74-45ed-ba3b-4c9311dd370c in Status: SUCCESS [ 677.128764] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-960b9480-1a74-45ed-ba3b-4c9311dd370c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.128764] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-960b9480-1a74-45ed-ba3b-4c9311dd370c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.128764] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-960b9480-1a74-45ed-ba3b-4c9311dd370c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.128764] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.128764] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.128764] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.130124] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.130124] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.130124] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-960b9480-1a74-45ed-ba3b-4c9311dd370c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.130124] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('960b9480-1a74-45ed-ba3b-4c9311dd370c',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.162948] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c16acdbe-d600-40de-b3d9-384201f1e513: rpc.has_security_group_logging(os_id): False [ 677.197604] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.197841] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.198167] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.198269] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.198269] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.198533] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.198674] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.198778] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.199046] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.199181] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.199295] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c16acdbe-d600-40de-b3d9-384201f1e513 is going to be created. [ 677.282703] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.282703] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.282703] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.282703] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.283044] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.303716] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c16acdbe-d600-40de-b3d9-384201f1e513 in Status: IN_PROGRESS for 2s [ 677.527254] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f3805be6-3069-4624-897e-f4bf1dc6cd31',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.530695] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('99423afc-7fd3-4e3d-8a84-f190e0af048f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.635119] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-960b9480-1a74-45ed-ba3b-4c9311dd370c taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.635119] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-960b9480-1a74-45ed-ba3b-4c9311dd370c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.635119] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-960b9480-1a74-45ed-ba3b-4c9311dd370c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.635119] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-960b9480-1a74-45ed-ba3b-4c9311dd370c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.635119] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.635119] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.635119] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.635119] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.635119] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.635119] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-960b9480-1a74-45ed-ba3b-4c9311dd370c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.635119] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-960b9480-1a74-45ed-ba3b-4c9311dd370c taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.635119] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-960b9480-1a74-45ed-ba3b-4c9311dd370c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.635119] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-960b9480-1a74-45ed-ba3b-4c9311dd370c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.635119] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-960b9480-1a74-45ed-ba3b-4c9311dd370c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.635119] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.635119] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.636052] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.636052] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.636052] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.636052] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-960b9480-1a74-45ed-ba3b-4c9311dd370c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.636052] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('960b9480-1a74-45ed-ba3b-4c9311dd370c',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.031594] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.031972] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.031972] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.032170] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.032270] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.032702] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3805be6-3069-4624-897e-f4bf1dc6cd31 is going to be updated. [ 678.034024] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.034024] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.034178] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.034334] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.034334] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.035090] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99423afc-7fd3-4e3d-8a84-f190e0af048f is going to be updated. [ 678.079046] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.079237] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.079237] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.079441] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.079622] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.085178] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.085178] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.085178] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.085178] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.085178] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.109480] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3805be6-3069-4624-897e-f4bf1dc6cd31 in Status: IN_PROGRESS for 2s [ 678.113305] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99423afc-7fd3-4e3d-8a84-f190e0af048f in Status: IN_PROGRESS for 2s [ 678.115569] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c587345b-51c8-42f7-8a0c-052027c4b18c in Status: SUCCESS [ 678.115897] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c587345b-51c8-42f7-8a0c-052027c4b18c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.140668] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 960b9480-1a74-45ed-ba3b-4c9311dd370c: rpc.has_security_group_logging(os_id): False [ 678.168780] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.168893] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.168893] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.169184] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.169672] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.169869] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.169980] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.170060] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.170310] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.170414] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.170622] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.170722] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.171356] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.171445] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.171528] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.171770] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.172371] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.172371] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.172371] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.172371] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.172371] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 960b9480-1a74-45ed-ba3b-4c9311dd370c is going to be created. [ 678.252947] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.254153] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.254252] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.254905] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.258407] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.273424] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 960b9480-1a74-45ed-ba3b-4c9311dd370c in Status: IN_PROGRESS for 2s [ 678.545304] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 678.545408] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=7 [ 679.322430] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c16acdbe-d600-40de-b3d9-384201f1e513 in Status: SUCCESS [ 679.322791] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c16acdbe-d600-40de-b3d9-384201f1e513" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.134667] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3805be6-3069-4624-897e-f4bf1dc6cd31 in Status: SUCCESS [ 680.134993] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3805be6-3069-4624-897e-f4bf1dc6cd31" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.135841] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99423afc-7fd3-4e3d-8a84-f190e0af048f in Status: SUCCESS [ 680.136016] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.136176] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3805be6-3069-4624-897e-f4bf1dc6cd31" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.136377] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3805be6-3069-4624-897e-f4bf1dc6cd31" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.136561] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.136914] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.137995] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.138370] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.141053] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.141053] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3805be6-3069-4624-897e-f4bf1dc6cd31" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.141053] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f3805be6-3069-4624-897e-f4bf1dc6cd31',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.141053] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.141301] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.141496] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.141677] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.141677] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.141870] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.141984] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.142159] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.142272] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-99423afc-7fd3-4e3d-8a84-f190e0af048f taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.142371] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.142431] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.142575] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.142714] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.142831] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.142874] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.142996] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.143340] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.143530] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.143600] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('99423afc-7fd3-4e3d-8a84-f190e0af048f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.295064] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 960b9480-1a74-45ed-ba3b-4c9311dd370c in Status: SUCCESS [ 680.295259] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-960b9480-1a74-45ed-ba3b-4c9311dd370c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.646454] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f3805be6-3069-4624-897e-f4bf1dc6cd31',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.647548] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 99423afc-7fd3-4e3d-8a84-f190e0af048f: rpc.has_security_group_logging(os_id): False [ 680.669208] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.669208] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.669208] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.669208] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.669208] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.669208] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.669208] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.669208] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.669208] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.669208] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.669208] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.669706] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.669706] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.669706] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.669706] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.669706] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.669893] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.669893] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.670785] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.671834] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.671834] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 99423afc-7fd3-4e3d-8a84-f190e0af048f is going to be updated. [ 680.743804] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.744465] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.744465] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.744465] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.744465] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.762042] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 99423afc-7fd3-4e3d-8a84-f190e0af048f in Status: IN_PROGRESS for 2s [ 681.149286] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f3805be6-3069-4624-897e-f4bf1dc6cd31: rpc.has_security_group_logging(os_id): False [ 681.167926] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.168249] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.168403] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.168614] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.168724] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.168978] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.169088] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.169159] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.169330] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.169412] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.169502] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f3805be6-3069-4624-897e-f4bf1dc6cd31 is going to be updated. [ 681.257684] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.257976] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.257976] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.258255] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.258415] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.275149] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f3805be6-3069-4624-897e-f4bf1dc6cd31 in Status: IN_PROGRESS for 2s [ 682.788291] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 99423afc-7fd3-4e3d-8a84-f190e0af048f in Status: SUCCESS [ 682.788291] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.788291] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.788291] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.788291] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('99423afc-7fd3-4e3d-8a84-f190e0af048f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.027206] env[65065]: INFO networking_nsxv3.common.synchronization [None req-dfc2fbf5-a1cc-4da9-9de1-80b0a5bd1941 None None] Enqueued Resource ID: 30ada783-984a-4d6f-ba0f-57bb3e15c25f with Priority: HIGHEST for action port [ 683.027206] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30ada783-984a-4d6f-ba0f-57bb3e15c25f with Priority: HIGHEST for action port [ 683.027895] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-30ada783-984a-4d6f-ba0f-57bb3e15c25f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.028328] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-30ada783-984a-4d6f-ba0f-57bb3e15c25f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.028520] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-30ada783-984a-4d6f-ba0f-57bb3e15c25f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.029104] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-30ada783-984a-4d6f-ba0f-57bb3e15c25f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.029340] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('30ada783-984a-4d6f-ba0f-57bb3e15c25f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.291130] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-99423afc-7fd3-4e3d-8a84-f190e0af048f taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.291411] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.291506] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.292889] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.296573] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.296833] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.296950] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.297257] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.297314] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.297428] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.297522] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('99423afc-7fd3-4e3d-8a84-f190e0af048f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.301903] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f3805be6-3069-4624-897e-f4bf1dc6cd31 in Status: SUCCESS [ 683.301903] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f3805be6-3069-4624-897e-f4bf1dc6cd31" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.519358] env[65065]: INFO networking_nsxv3.common.synchronization [None req-c0316b22-dd49-4fc0-8bc8-95bf63518dbb None None] Enqueued Resource ID: b31ba9af-6f42-459e-8bc8-892a250d9c7e with Priority: HIGHEST for action port [ 683.519941] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b31ba9af-6f42-459e-8bc8-892a250d9c7e with Priority: HIGHEST for action port [ 683.521273] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-b31ba9af-6f42-459e-8bc8-892a250d9c7e taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.521439] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b31ba9af-6f42-459e-8bc8-892a250d9c7e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.521935] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b31ba9af-6f42-459e-8bc8-892a250d9c7e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.522252] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b31ba9af-6f42-459e-8bc8-892a250d9c7e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.522370] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b31ba9af-6f42-459e-8bc8-892a250d9c7e',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.533133] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 30ada783-984a-4d6f-ba0f-57bb3e15c25f [ 683.533362] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.533487] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.533546] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.533747] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.534050] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.534050] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:30ada783-984a-4d6f-ba0f-57bb3e15c25f already deleted. [ 683.534050] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-30ada783-984a-4d6f-ba0f-57bb3e15c25f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.803527] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-99423afc-7fd3-4e3d-8a84-f190e0af048f taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.803801] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.803801] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.804585] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.804585] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.804585] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.804585] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.804585] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.804585] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.804585] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.804786] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-99423afc-7fd3-4e3d-8a84-f190e0af048f taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.804786] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.804856] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.804964] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.805106] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.805193] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.805246] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.805376] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.805443] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.805517] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.805627] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('99423afc-7fd3-4e3d-8a84-f190e0af048f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.024936] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b31ba9af-6f42-459e-8bc8-892a250d9c7e [ 684.025414] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.025414] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.025570] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.026343] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.026451] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.026565] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b31ba9af-6f42-459e-8bc8-892a250d9c7e already deleted. [ 684.026735] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b31ba9af-6f42-459e-8bc8-892a250d9c7e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.082903] env[65065]: INFO networking_nsxv3.common.synchronization [req-ebb61a14-0bc8-41bb-90b3-0470ffb474de req-ab3346e6-511a-4a92-95e4-3794506a0602 tempest-ImagesOneServerNegativeTestJSON-764093247 tempest-ImagesOneServerNegativeTestJSON-764093247-project-member] Enqueued Resource ID: 9ed22036-e9a4-4639-89b9-c743ca686b09 with Priority: HIGHEST for action security_group_members [ 684.084082] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ed22036-e9a4-4639-89b9-c743ca686b09 with Priority: HIGHEST for action security_group_members [ 684.084082] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ed22036-e9a4-4639-89b9-c743ca686b09 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.084082] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ed22036-e9a4-4639-89b9-c743ca686b09" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.084082] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ed22036-e9a4-4639-89b9-c743ca686b09" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.084489] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ed22036-e9a4-4639-89b9-c743ca686b09" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.084489] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.084594] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.084647] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.084891] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.084984] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.085892] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ed22036-e9a4-4639-89b9-c743ca686b09',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.315523] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 99423afc-7fd3-4e3d-8a84-f190e0af048f: rpc.has_security_group_logging(os_id): False [ 684.339930] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.340118] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.340425] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.340736] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.340897] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.341728] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.341728] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.341728] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.341728] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.341728] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.342029] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.342092] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.342132] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.343884] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.343884] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.343884] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.343884] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.343884] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.343884] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.343884] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.343884] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 99423afc-7fd3-4e3d-8a84-f190e0af048f is going to be updated. [ 684.413019] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.413208] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.413483] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.413541] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.413696] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.431369] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 99423afc-7fd3-4e3d-8a84-f190e0af048f in Status: IN_PROGRESS for 2s [ 684.570043] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock network-105 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.570043] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "network-105" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.570043] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "network-105" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.570043] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "network-105" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.570633] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.570928] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.571145] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.571604] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.571921] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.572739] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 684.572739] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 684.572739] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 684.572965] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 684.573051] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 684.573228] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 684.573316] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 684.589019] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.589019] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.589019] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.589019] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.589019] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.589019] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.589019] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.589019] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.589386] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.589386] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.589386] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ed22036-e9a4-4639-89b9-c743ca686b09 already deleted. [ 684.589386] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ed22036-e9a4-4639-89b9-c743ca686b09" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.600459] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 684.600609] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 684.600745] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 684.600926] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "network-105" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.601268] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock port-1bee8a82-a013-4d29-8d9e-6111a3cd9a72 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.601454] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "port-1bee8a82-a013-4d29-8d9e-6111a3cd9a72" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.601549] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "port-1bee8a82-a013-4d29-8d9e-6111a3cd9a72" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.601887] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "port-1bee8a82-a013-4d29-8d9e-6111a3cd9a72" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.602030] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1bee8a82-a013-4d29-8d9e-6111a3cd9a72',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.105563] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.106148] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.106148] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.106268] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.106348] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.106498] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Segment Port 1bee8a82-a013-4d29-8d9e-6111a3cd9a72 not found, creating... [ 685.106783] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.106919] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.106995] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.107259] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.107338] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.107616] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.107861] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.107975] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.108324] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.108471] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.108867] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Resource: SegmentPort with ID: 1bee8a82-a013-4d29-8d9e-6111a3cd9a72 is going to be created. [ 685.130476] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.130660] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.130776] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.131309] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.131564] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.131838] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "port-1bee8a82-a013-4d29-8d9e-6111a3cd9a72" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.880271] env[65065]: INFO networking_nsxv3.common.synchronization [req-ebb61a14-0bc8-41bb-90b3-0470ffb474de req-cc330ae9-1569-4c41-982e-105e6b0ab896 service nova] Enqueued Resource ID: 9ed22036-e9a4-4639-89b9-c743ca686b09 with Priority: HIGHEST for action security_group_rules [ 685.880271] env[65065]: INFO networking_nsxv3.common.synchronization [req-ebb61a14-0bc8-41bb-90b3-0470ffb474de req-cc330ae9-1569-4c41-982e-105e6b0ab896 service nova] Enqueued Resource ID: 9ed22036-e9a4-4639-89b9-c743ca686b09 with Priority: HIGHEST for action security_group_members [ 685.880271] env[65065]: INFO networking_nsxv3.common.synchronization [req-ebb61a14-0bc8-41bb-90b3-0470ffb474de req-cc330ae9-1569-4c41-982e-105e6b0ab896 service nova] Enqueued Resource ID: 1bee8a82-a013-4d29-8d9e-6111a3cd9a72 with Priority: HIGHEST for action port [ 685.880271] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ed22036-e9a4-4639-89b9-c743ca686b09 with Priority: HIGHEST for action security_group_rules [ 685.880271] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ed22036-e9a4-4639-89b9-c743ca686b09 with Priority: HIGHEST for action security_group_members [ 685.880594] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bee8a82-a013-4d29-8d9e-6111a3cd9a72 with Priority: HIGHEST for action port [ 685.881216] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9ed22036-e9a4-4639-89b9-c743ca686b09 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.881369] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9ed22036-e9a4-4639-89b9-c743ca686b09" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.881448] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9ed22036-e9a4-4639-89b9-c743ca686b09" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.881712] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9ed22036-e9a4-4639-89b9-c743ca686b09" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.881789] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9ed22036-e9a4-4639-89b9-c743ca686b09',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.883035] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ed22036-e9a4-4639-89b9-c743ca686b09 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.883035] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ed22036-e9a4-4639-89b9-c743ca686b09" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.883035] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ed22036-e9a4-4639-89b9-c743ca686b09" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.883188] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ed22036-e9a4-4639-89b9-c743ca686b09" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.883925] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.883925] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.883925] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.883925] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.883925] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.883925] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ed22036-e9a4-4639-89b9-c743ca686b09',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.885010] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-1bee8a82-a013-4d29-8d9e-6111a3cd9a72 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.885117] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1bee8a82-a013-4d29-8d9e-6111a3cd9a72" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.885181] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1bee8a82-a013-4d29-8d9e-6111a3cd9a72" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.885437] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1bee8a82-a013-4d29-8d9e-6111a3cd9a72" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.885537] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1bee8a82-a013-4d29-8d9e-6111a3cd9a72',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.114318] env[65065]: INFO networking_nsxv3.common.synchronization [None req-a23a1330-4822-4887-bb15-6021a580bc73 None None] Enqueued Resource ID: 68725839-007a-4936-9fcb-c12b6d163fde with Priority: HIGHEST for action port [ 686.114898] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68725839-007a-4936-9fcb-c12b6d163fde with Priority: HIGHEST for action port [ 686.115260] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-68725839-007a-4936-9fcb-c12b6d163fde taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.115341] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-68725839-007a-4936-9fcb-c12b6d163fde" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.116316] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-68725839-007a-4936-9fcb-c12b6d163fde" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.116316] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-68725839-007a-4936-9fcb-c12b6d163fde" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.116316] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('68725839-007a-4936-9fcb-c12b6d163fde',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.390039] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ed22036-e9a4-4639-89b9-c743ca686b09 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.390039] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ed22036-e9a4-4639-89b9-c743ca686b09" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.390039] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1bee8a82-a013-4d29-8d9e-6111a3cd9a72 with status ACTIVE [ 686.390279] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.390279] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.390361] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.390533] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.390622] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.392853] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.392853] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.392853] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.392853] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.392853] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.392853] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.392853] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.392853] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.392853] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.392853] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.392853] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1bee8a82-a013-4d29-8d9e-6111a3cd9a72 is going to be updated. [ 686.393373] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9ed22036-e9a4-4639-89b9-c743ca686b09',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.417278] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.417447] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.417486] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.417839] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.417986] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.418461] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1bee8a82-a013-4d29-8d9e-6111a3cd9a72" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.450101] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 99423afc-7fd3-4e3d-8a84-f190e0af048f in Status: SUCCESS [ 686.450101] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.507738] env[65065]: INFO networking_nsxv3.common.synchronization [req-238114f4-b867-483f-98f7-1809b4cefd03 req-f44545d4-8ed4-4e27-b189-04ddd1ee52fa tempest-ServersAdminTestJSON-1746807080 tempest-ServersAdminTestJSON-1746807080-project-member] Enqueued Resource ID: ed4053b7-493c-48f8-b82e-b002cbcc3a61 with Priority: HIGHEST for action security_group_members [ 686.508062] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed4053b7-493c-48f8-b82e-b002cbcc3a61 with Priority: HIGHEST for action security_group_members [ 686.508363] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed4053b7-493c-48f8-b82e-b002cbcc3a61 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.508482] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.508548] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.508744] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.509279] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.510062] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.510145] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.510325] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.510413] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.510509] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ed4053b7-493c-48f8-b82e-b002cbcc3a61',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.590287] env[65065]: INFO networking_nsxv3.common.synchronization [None req-10471e79-74e6-484e-b5e9-ebffa59c4051 None None] Enqueued Resource ID: e293f29e-9d66-4940-8a34-d68c05ba35a9 with Priority: HIGHEST for action port [ 686.592092] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e293f29e-9d66-4940-8a34-d68c05ba35a9 with Priority: HIGHEST for action port [ 686.592444] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-e293f29e-9d66-4940-8a34-d68c05ba35a9 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.592578] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e293f29e-9d66-4940-8a34-d68c05ba35a9" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.592650] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e293f29e-9d66-4940-8a34-d68c05ba35a9" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.592957] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e293f29e-9d66-4940-8a34-d68c05ba35a9" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.593076] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e293f29e-9d66-4940-8a34-d68c05ba35a9',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.617944] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 68725839-007a-4936-9fcb-c12b6d163fde [ 686.619028] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.619231] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.619309] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.619921] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.620077] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.620182] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:68725839-007a-4936-9fcb-c12b6d163fde already deleted. [ 686.620271] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-68725839-007a-4936-9fcb-c12b6d163fde" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.900029] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9ed22036-e9a4-4639-89b9-c743ca686b09',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.905098] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock network-829 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.906145] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "network-829" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.906287] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "network-829" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.906705] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "network-829" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.909115] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.909357] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.909566] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.909929] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.910159] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.910828] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 686.911020] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 686.911215] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 686.911353] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 686.911879] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 686.911879] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 686.911879] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 686.934728] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 686.934948] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 686.935224] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 686.935443] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "network-829" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.935878] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock port-a553390b-6fc6-4e78-8a59-f6aba5bfb517 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.936085] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "port-a553390b-6fc6-4e78-8a59-f6aba5bfb517" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.936413] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "port-a553390b-6fc6-4e78-8a59-f6aba5bfb517" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.936876] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "port-a553390b-6fc6-4e78-8a59-f6aba5bfb517" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.937046] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a553390b-6fc6-4e78-8a59-f6aba5bfb517',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.017378] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ed4053b7-493c-48f8-b82e-b002cbcc3a61',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.094787] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e293f29e-9d66-4940-8a34-d68c05ba35a9 [ 687.095091] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.095232] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.095316] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.095583] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.095583] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.095757] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e293f29e-9d66-4940-8a34-d68c05ba35a9 already deleted. [ 687.096017] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e293f29e-9d66-4940-8a34-d68c05ba35a9" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.404174] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.404562] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.404562] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.404624] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.404709] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.404783] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ed22036-e9a4-4639-89b9-c743ca686b09 is going to be created. [ 687.430934] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.430934] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.431221] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.431722] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.432090] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.439922] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.440407] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.440407] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.440558] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.440838] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.440909] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Segment Port a553390b-6fc6-4e78-8a59-f6aba5bfb517 not found, creating... [ 687.441315] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.441315] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.441420] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.441628] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.441767] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.442081] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.442233] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.442399] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.442554] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.442696] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.442878] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Resource: SegmentPort with ID: a553390b-6fc6-4e78-8a59-f6aba5bfb517 is going to be created. [ 687.445291] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ed22036-e9a4-4639-89b9-c743ca686b09 in Status: UNINITIALIZED for 2s [ 687.468397] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.468671] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.468787] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.469102] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.469507] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.469775] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "port-a553390b-6fc6-4e78-8a59-f6aba5bfb517" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.521788] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ed4053b7-493c-48f8-b82e-b002cbcc3a61',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.024317] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.024542] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.024607] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.024895] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.025126] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.025234] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ed4053b7-493c-48f8-b82e-b002cbcc3a61 is going to be updated. [ 688.178047] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.178047] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.178047] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.178304] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.178304] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.192394] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed4053b7-493c-48f8-b82e-b002cbcc3a61 in Status: IN_PROGRESS for 2s [ 688.261323] env[65065]: INFO networking_nsxv3.common.synchronization [req-238114f4-b867-483f-98f7-1809b4cefd03 req-2c943e9d-af6f-4cbd-81ea-12484fac8a7b service nova] Enqueued Resource ID: ed4053b7-493c-48f8-b82e-b002cbcc3a61 with Priority: HIGHEST for action security_group_rules [ 688.261496] env[65065]: INFO networking_nsxv3.common.synchronization [req-238114f4-b867-483f-98f7-1809b4cefd03 req-2c943e9d-af6f-4cbd-81ea-12484fac8a7b service nova] Enqueued Resource ID: ed4053b7-493c-48f8-b82e-b002cbcc3a61 with Priority: HIGHEST for action security_group_members [ 688.262689] env[65065]: INFO networking_nsxv3.common.synchronization [req-238114f4-b867-483f-98f7-1809b4cefd03 req-2c943e9d-af6f-4cbd-81ea-12484fac8a7b service nova] Enqueued Resource ID: a553390b-6fc6-4e78-8a59-f6aba5bfb517 with Priority: HIGHEST for action port [ 688.262689] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed4053b7-493c-48f8-b82e-b002cbcc3a61 with Priority: HIGHEST for action security_group_rules [ 688.262689] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed4053b7-493c-48f8-b82e-b002cbcc3a61 with Priority: HIGHEST for action security_group_members [ 688.262689] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a553390b-6fc6-4e78-8a59-f6aba5bfb517 with Priority: HIGHEST for action port [ 688.263641] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ed4053b7-493c-48f8-b82e-b002cbcc3a61 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.263791] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.264308] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.264723] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.264978] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ed4053b7-493c-48f8-b82e-b002cbcc3a61',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.266887] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed4053b7-493c-48f8-b82e-b002cbcc3a61 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.266887] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.266887] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-a553390b-6fc6-4e78-8a59-f6aba5bfb517 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.266887] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a553390b-6fc6-4e78-8a59-f6aba5bfb517" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.267073] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a553390b-6fc6-4e78-8a59-f6aba5bfb517" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.267190] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a553390b-6fc6-4e78-8a59-f6aba5bfb517" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.267236] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a553390b-6fc6-4e78-8a59-f6aba5bfb517',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.769829] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed4053b7-493c-48f8-b82e-b002cbcc3a61 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.769829] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.769829] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a553390b-6fc6-4e78-8a59-f6aba5bfb517 with status ACTIVE [ 688.769829] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.769829] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.769829] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.770659] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.770659] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.770659] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.770659] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.770659] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.770659] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.770659] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.770839] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.770839] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.770900] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.771112] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.771112] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.771246] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a553390b-6fc6-4e78-8a59-f6aba5bfb517 is going to be updated. [ 688.798355] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.798508] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.802091] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.802091] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.802091] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.802091] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a553390b-6fc6-4e78-8a59-f6aba5bfb517" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.999833] env[65065]: INFO networking_nsxv3.common.synchronization [req-bb9ed85f-0920-4b7e-8a5c-08879751765e req-b5366cf1-09f6-4699-8b38-625cfd777a62 tempest-ImagesTestJSON-1714479415 tempest-ImagesTestJSON-1714479415-project-member] Enqueued Resource ID: e6d7baac-4bff-46b9-b88d-2dc982621c0f with Priority: HIGHEST for action security_group_members [ 689.000502] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6d7baac-4bff-46b9-b88d-2dc982621c0f with Priority: HIGHEST for action security_group_members [ 689.001444] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6d7baac-4bff-46b9-b88d-2dc982621c0f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.001444] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.001444] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.001444] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.001444] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.001835] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.001910] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.002095] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.002218] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.002384] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e6d7baac-4bff-46b9-b88d-2dc982621c0f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.273540] env[65065]: INFO networking_nsxv3.common.synchronization [req-06d9b4f3-ba49-449e-95bb-fce3de39e9c2 req-524879bc-82bd-454d-8935-32db0a5a3260 tempest-SecurityGroupRulesTestJSON-1358109699 tempest-SecurityGroupRulesTestJSON-1358109699-project-member] Enqueued Resource ID: c8ef8572-ee44-4c1f-bc08-ed78224cf129 with Priority: HIGHEST for action security_group_rules [ 689.273690] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8ef8572-ee44-4c1f-bc08-ed78224cf129 with Priority: HIGHEST for action security_group_rules [ 689.273998] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c8ef8572-ee44-4c1f-bc08-ed78224cf129 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.274140] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c8ef8572-ee44-4c1f-bc08-ed78224cf129" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.274206] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c8ef8572-ee44-4c1f-bc08-ed78224cf129" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.274454] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c8ef8572-ee44-4c1f-bc08-ed78224cf129" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.274534] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c8ef8572-ee44-4c1f-bc08-ed78224cf129',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.459282] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ed22036-e9a4-4639-89b9-c743ca686b09 in Status: SUCCESS [ 689.459623] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ed22036-e9a4-4639-89b9-c743ca686b09" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.459888] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ed22036-e9a4-4639-89b9-c743ca686b09" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.460263] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ed22036-e9a4-4639-89b9-c743ca686b09" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.460539] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.460715] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.460826] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.461516] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.461668] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.461799] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ed22036-e9a4-4639-89b9-c743ca686b09" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.461930] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9ed22036-e9a4-4639-89b9-c743ca686b09',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.505494] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.505494] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.505494] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.505494] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.505494] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.505719] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.505719] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.505719] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.505905] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.505936] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.506023] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6d7baac-4bff-46b9-b88d-2dc982621c0f is going to be updated. [ 689.538010] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.538168] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.538237] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.539233] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.540192] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.551178] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6d7baac-4bff-46b9-b88d-2dc982621c0f in Status: IN_PROGRESS for 2s [ 689.802392] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.802743] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.802743] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.802814] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.802908] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.803014] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c8ef8572-ee44-4c1f-bc08-ed78224cf129 already deleted. [ 689.803098] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c8ef8572-ee44-4c1f-bc08-ed78224cf129" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.965152] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ed22036-e9a4-4639-89b9-c743ca686b09 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.965659] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ed22036-e9a4-4639-89b9-c743ca686b09" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.965659] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ed22036-e9a4-4639-89b9-c743ca686b09" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.965910] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ed22036-e9a4-4639-89b9-c743ca686b09" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.966228] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.966376] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.966454] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.967327] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.967437] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.967538] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ed22036-e9a4-4639-89b9-c743ca686b09" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.967802] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ed22036-e9a4-4639-89b9-c743ca686b09 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.967960] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ed22036-e9a4-4639-89b9-c743ca686b09" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.968045] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ed22036-e9a4-4639-89b9-c743ca686b09" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.968221] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ed22036-e9a4-4639-89b9-c743ca686b09" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.968376] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.968475] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.968539] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.968700] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.968885] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.969054] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ed22036-e9a4-4639-89b9-c743ca686b09" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.969130] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9ed22036-e9a4-4639-89b9-c743ca686b09',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.205071] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed4053b7-493c-48f8-b82e-b002cbcc3a61 in Status: SUCCESS [ 690.205285] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.205456] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.205708] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.205899] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.206027] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.206095] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.206251] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.206332] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.206426] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ed4053b7-493c-48f8-b82e-b002cbcc3a61',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.471453] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9ed22036-e9a4-4639-89b9-c743ca686b09: rpc.has_security_group_logging(os_id): False [ 690.496382] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.496382] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.496382] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.496382] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.496382] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.496382] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.496382] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.496382] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.496382] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.496382] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.496382] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.496382] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.496382] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.496382] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.496382] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.497426] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.497426] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.497426] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.497426] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.497426] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.497426] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9ed22036-e9a4-4639-89b9-c743ca686b09 is going to be created. [ 690.577436] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.578825] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.578825] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.578825] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.578825] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.595088] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9ed22036-e9a4-4639-89b9-c743ca686b09 in Status: IN_PROGRESS for 2s [ 690.710912] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ed4053b7-493c-48f8-b82e-b002cbcc3a61',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.213463] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ed4053b7-493c-48f8-b82e-b002cbcc3a61',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.561276] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6d7baac-4bff-46b9-b88d-2dc982621c0f in Status: SUCCESS [ 691.561459] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6d7baac-4bff-46b9-b88d-2dc982621c0f deletion is rescheduled due to dependency. [ 691.561575] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.715971] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.716289] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.716405] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.716713] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.716836] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.716951] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ed4053b7-493c-48f8-b82e-b002cbcc3a61 is going to be updated. [ 691.749215] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.749215] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.749215] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.749397] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.749778] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.761102] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed4053b7-493c-48f8-b82e-b002cbcc3a61 in Status: IN_PROGRESS for 2s [ 692.110077] env[65065]: INFO networking_nsxv3.common.synchronization [req-5fc7bd0e-ca52-4599-acc8-95fc39079769 req-af369050-0d56-44e6-94cc-7572da0305e3 tempest-SecurityGroupRulesTestJSON-1358109699 tempest-SecurityGroupRulesTestJSON-1358109699-project-member] Enqueued Resource ID: e9748ad4-90bf-418f-a978-a4a73d4f7f41 with Priority: HIGHEST for action security_group_rules [ 692.110768] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9748ad4-90bf-418f-a978-a4a73d4f7f41 with Priority: HIGHEST for action security_group_rules [ 692.111583] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e9748ad4-90bf-418f-a978-a4a73d4f7f41 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.111829] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e9748ad4-90bf-418f-a978-a4a73d4f7f41" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.111928] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e9748ad4-90bf-418f-a978-a4a73d4f7f41" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.112202] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e9748ad4-90bf-418f-a978-a4a73d4f7f41" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.112269] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e9748ad4-90bf-418f-a978-a4a73d4f7f41',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.616356] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9ed22036-e9a4-4639-89b9-c743ca686b09 in Status: SUCCESS [ 692.616356] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9ed22036-e9a4-4639-89b9-c743ca686b09" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.641242] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.641242] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.641242] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.641405] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.641405] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.641455] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e9748ad4-90bf-418f-a978-a4a73d4f7f41 already deleted. [ 692.641550] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e9748ad4-90bf-418f-a978-a4a73d4f7f41" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.980443] env[65065]: INFO networking_nsxv3.common.synchronization [req-80a521c1-d4d6-49e6-a814-788842e93949 req-531d5ce2-be12-4283-98ee-899261055409 tempest-ServersWithSpecificFlavorTestJSON-1007896152 tempest-ServersWithSpecificFlavorTestJSON-1007896152-project-member] Enqueued Resource ID: 9576b45f-b344-47bd-8f8b-9df4c3725ddb with Priority: HIGHEST for action security_group_members [ 692.985125] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9576b45f-b344-47bd-8f8b-9df4c3725ddb with Priority: HIGHEST for action security_group_members [ 692.985125] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-9576b45f-b344-47bd-8f8b-9df4c3725ddb taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.985125] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9576b45f-b344-47bd-8f8b-9df4c3725ddb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.985125] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9576b45f-b344-47bd-8f8b-9df4c3725ddb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.985125] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9576b45f-b344-47bd-8f8b-9df4c3725ddb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.985125] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.985125] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.985125] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.985125] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.985125] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.985125] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9576b45f-b344-47bd-8f8b-9df4c3725ddb',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.492093] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.492422] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.492422] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.493164] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.493164] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.493446] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.493523] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.493659] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.494887] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.494981] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.495093] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9576b45f-b344-47bd-8f8b-9df4c3725ddb is going to be updated. [ 693.543319] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.543319] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.543319] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.543319] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.543319] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.553946] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9576b45f-b344-47bd-8f8b-9df4c3725ddb in Status: IN_PROGRESS for 2s [ 693.776910] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed4053b7-493c-48f8-b82e-b002cbcc3a61 in Status: SUCCESS [ 693.776910] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.776910] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.776910] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.776910] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.776910] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.777517] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.777517] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.777517] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.777517] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.777517] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ed4053b7-493c-48f8-b82e-b002cbcc3a61',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.282645] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed4053b7-493c-48f8-b82e-b002cbcc3a61 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.282645] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.282645] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.282645] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.282645] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.282645] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.282645] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.282645] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.282645] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.282645] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.282645] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed4053b7-493c-48f8-b82e-b002cbcc3a61 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.282645] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.282645] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.282645] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.283945] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.283945] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.286764] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.287055] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.287213] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.288340] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.288340] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ed4053b7-493c-48f8-b82e-b002cbcc3a61',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.793837] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ed4053b7-493c-48f8-b82e-b002cbcc3a61: rpc.has_security_group_logging(os_id): False [ 694.822374] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.822540] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.822606] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.823958] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.823958] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.823958] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.823958] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.823958] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.823958] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.823958] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.823958] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.824296] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.824296] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.824296] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.824296] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.825347] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.825347] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.825347] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.825347] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.825347] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.825347] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ed4053b7-493c-48f8-b82e-b002cbcc3a61 is going to be updated. [ 694.921466] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.925616] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.925616] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.925711] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.925889] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.949757] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ed4053b7-493c-48f8-b82e-b002cbcc3a61 in Status: IN_PROGRESS for 2s [ 695.570970] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9576b45f-b344-47bd-8f8b-9df4c3725ddb in Status: SUCCESS [ 695.572315] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9576b45f-b344-47bd-8f8b-9df4c3725ddb deletion is rescheduled due to dependency. [ 695.572315] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9576b45f-b344-47bd-8f8b-9df4c3725ddb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.722486] env[65065]: INFO networking_nsxv3.common.synchronization [None req-52ac4b24-bf78-4dd1-9aef-9588efb06ea1 None None] Enqueued Resource ID: eb99d0b5-fa96-4f47-8718-c7f4e4f7a597 with Priority: HIGHEST for action port [ 695.725565] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb99d0b5-fa96-4f47-8718-c7f4e4f7a597 with Priority: HIGHEST for action port [ 695.726146] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-eb99d0b5-fa96-4f47-8718-c7f4e4f7a597 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.726358] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eb99d0b5-fa96-4f47-8718-c7f4e4f7a597" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.726470] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eb99d0b5-fa96-4f47-8718-c7f4e4f7a597" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.726811] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eb99d0b5-fa96-4f47-8718-c7f4e4f7a597" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.727438] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eb99d0b5-fa96-4f47-8718-c7f4e4f7a597',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.232967] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port eb99d0b5-fa96-4f47-8718-c7f4e4f7a597 [ 696.233353] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.233497] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.233561] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.233837] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.233837] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.233993] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:eb99d0b5-fa96-4f47-8718-c7f4e4f7a597 already deleted. [ 696.234069] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eb99d0b5-fa96-4f47-8718-c7f4e4f7a597" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.402859] env[65065]: INFO networking_nsxv3.common.synchronization [req-fe06e6cf-3071-4c38-ae8f-860d71135ef4 req-8bc6ba31-5434-4b84-bd3a-5f0e7e7ce857 tempest-ServerRescueTestJSONUnderV235-262437214 tempest-ServerRescueTestJSONUnderV235-262437214-project-member] Enqueued Resource ID: 83648dc4-e98f-47b1-b96c-2c0a05ebae74 with Priority: HIGHEST for action security_group_members [ 696.403738] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83648dc4-e98f-47b1-b96c-2c0a05ebae74 with Priority: HIGHEST for action security_group_members [ 696.403824] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-83648dc4-e98f-47b1-b96c-2c0a05ebae74 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.404365] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83648dc4-e98f-47b1-b96c-2c0a05ebae74" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.404365] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83648dc4-e98f-47b1-b96c-2c0a05ebae74" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.404813] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83648dc4-e98f-47b1-b96c-2c0a05ebae74" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.404953] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.405141] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.405141] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.405338] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.405446] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.405549] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('83648dc4-e98f-47b1-b96c-2c0a05ebae74',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.910557] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.910557] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.910557] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.910557] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.910557] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.910557] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.910557] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.910557] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.910557] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.910557] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.910557] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 83648dc4-e98f-47b1-b96c-2c0a05ebae74 already deleted. [ 696.910557] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83648dc4-e98f-47b1-b96c-2c0a05ebae74" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.971078] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ed4053b7-493c-48f8-b82e-b002cbcc3a61 in Status: SUCCESS [ 696.971078] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.116910] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock network-136 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.117109] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "network-136" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.117156] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "network-136" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.117508] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "network-136" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.117836] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.118216] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.118390] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.118670] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.118862] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.119111] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 697.119231] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 697.119353] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 697.119461] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 697.119566] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 697.119689] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 697.119831] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 697.151436] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 697.154026] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 697.154026] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 697.154026] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "network-136" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.154026] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock port-ba9173ab-6222-47e3-b895-afd2fa79a40c taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.154026] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "port-ba9173ab-6222-47e3-b895-afd2fa79a40c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.154026] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "port-ba9173ab-6222-47e3-b895-afd2fa79a40c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.154026] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "port-ba9173ab-6222-47e3-b895-afd2fa79a40c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.154026] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ba9173ab-6222-47e3-b895-afd2fa79a40c',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.658180] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.658533] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.658720] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.659163] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.659764] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.659764] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Segment Port ba9173ab-6222-47e3-b895-afd2fa79a40c not found, creating... [ 697.660999] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.661746] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.661989] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.662449] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.662692] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.663331] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.663547] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.663755] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.664120] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.664375] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.664789] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Resource: SegmentPort with ID: ba9173ab-6222-47e3-b895-afd2fa79a40c is going to be created. [ 697.694866] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.695180] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.695298] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.695581] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.695892] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.696149] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "port-ba9173ab-6222-47e3-b895-afd2fa79a40c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.511244] env[65065]: INFO networking_nsxv3.common.synchronization [req-fe06e6cf-3071-4c38-ae8f-860d71135ef4 req-4dfc9e08-72f5-48cf-8f0d-8d97360a0e8c service nova] Enqueued Resource ID: 83648dc4-e98f-47b1-b96c-2c0a05ebae74 with Priority: HIGHEST for action security_group_rules [ 698.511244] env[65065]: INFO networking_nsxv3.common.synchronization [req-fe06e6cf-3071-4c38-ae8f-860d71135ef4 req-4dfc9e08-72f5-48cf-8f0d-8d97360a0e8c service nova] Enqueued Resource ID: 83648dc4-e98f-47b1-b96c-2c0a05ebae74 with Priority: HIGHEST for action security_group_members [ 698.511244] env[65065]: INFO networking_nsxv3.common.synchronization [req-fe06e6cf-3071-4c38-ae8f-860d71135ef4 req-4dfc9e08-72f5-48cf-8f0d-8d97360a0e8c service nova] Enqueued Resource ID: ba9173ab-6222-47e3-b895-afd2fa79a40c with Priority: HIGHEST for action port [ 698.511841] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83648dc4-e98f-47b1-b96c-2c0a05ebae74 with Priority: HIGHEST for action security_group_rules [ 698.512066] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83648dc4-e98f-47b1-b96c-2c0a05ebae74 with Priority: HIGHEST for action security_group_members [ 698.512386] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba9173ab-6222-47e3-b895-afd2fa79a40c with Priority: HIGHEST for action port [ 698.513548] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-83648dc4-e98f-47b1-b96c-2c0a05ebae74 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.513548] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-83648dc4-e98f-47b1-b96c-2c0a05ebae74" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.513548] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-83648dc4-e98f-47b1-b96c-2c0a05ebae74" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.513802] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-83648dc4-e98f-47b1-b96c-2c0a05ebae74" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.513870] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('83648dc4-e98f-47b1-b96c-2c0a05ebae74',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.515859] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-83648dc4-e98f-47b1-b96c-2c0a05ebae74 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.516566] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83648dc4-e98f-47b1-b96c-2c0a05ebae74" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.516566] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83648dc4-e98f-47b1-b96c-2c0a05ebae74" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.516566] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83648dc4-e98f-47b1-b96c-2c0a05ebae74" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.516803] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.516912] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.517040] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.517278] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.517414] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.517580] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('83648dc4-e98f-47b1-b96c-2c0a05ebae74',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.520016] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-ba9173ab-6222-47e3-b895-afd2fa79a40c taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.520016] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ba9173ab-6222-47e3-b895-afd2fa79a40c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.520016] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ba9173ab-6222-47e3-b895-afd2fa79a40c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.520016] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ba9173ab-6222-47e3-b895-afd2fa79a40c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.521277] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ba9173ab-6222-47e3-b895-afd2fa79a40c',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.643873] env[65065]: INFO networking_nsxv3.common.synchronization [None req-e2523ccb-9f2e-4ffb-a40a-6f8dd962e92a None None] Enqueued Resource ID: a00c0b7c-3528-41cf-8bb6-b5dca3049f10 with Priority: HIGHEST for action port [ 698.646402] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a00c0b7c-3528-41cf-8bb6-b5dca3049f10 with Priority: HIGHEST for action port [ 698.647188] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-a00c0b7c-3528-41cf-8bb6-b5dca3049f10 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.647465] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a00c0b7c-3528-41cf-8bb6-b5dca3049f10" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.647579] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a00c0b7c-3528-41cf-8bb6-b5dca3049f10" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.648164] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a00c0b7c-3528-41cf-8bb6-b5dca3049f10" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.648237] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a00c0b7c-3528-41cf-8bb6-b5dca3049f10',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.830667] env[65065]: INFO networking_nsxv3.common.synchronization [req-084d5722-2d55-476e-beb2-cb6866835861 req-76246cc8-f5a4-45d6-819c-570ad5e007f7 tempest-InstanceActionsNegativeTestJSON-78954398 tempest-InstanceActionsNegativeTestJSON-78954398-project-member] Enqueued Resource ID: 960b9480-1a74-45ed-ba3b-4c9311dd370c with Priority: HIGHEST for action security_group_members [ 698.831096] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 960b9480-1a74-45ed-ba3b-4c9311dd370c with Priority: HIGHEST for action security_group_members [ 698.831425] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-960b9480-1a74-45ed-ba3b-4c9311dd370c taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.831570] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-960b9480-1a74-45ed-ba3b-4c9311dd370c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.831629] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-960b9480-1a74-45ed-ba3b-4c9311dd370c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.831798] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-960b9480-1a74-45ed-ba3b-4c9311dd370c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.831943] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.832077] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.832157] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.832327] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.832411] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.832639] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('960b9480-1a74-45ed-ba3b-4c9311dd370c',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.022034] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-83648dc4-e98f-47b1-b96c-2c0a05ebae74 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.022034] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83648dc4-e98f-47b1-b96c-2c0a05ebae74" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.022231] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('83648dc4-e98f-47b1-b96c-2c0a05ebae74',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.023264] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ba9173ab-6222-47e3-b895-afd2fa79a40c with status ACTIVE [ 699.023546] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.023647] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.023763] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.023993] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.024121] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.024360] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.024498] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.024540] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.024765] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.024883] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.025516] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.025684] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.025802] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.026080] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.026247] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.026384] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ba9173ab-6222-47e3-b895-afd2fa79a40c is going to be updated. [ 699.056148] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.056307] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.056381] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.056621] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.056767] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.056961] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ba9173ab-6222-47e3-b895-afd2fa79a40c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.152220] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a00c0b7c-3528-41cf-8bb6-b5dca3049f10 [ 699.152416] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.152890] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.152990] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.153265] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.156876] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.156876] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a00c0b7c-3528-41cf-8bb6-b5dca3049f10 already deleted. [ 699.156876] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a00c0b7c-3528-41cf-8bb6-b5dca3049f10" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.337535] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.337535] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.337535] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.337535] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.337535] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.337535] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.337535] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.337535] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.337535] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.337535] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.337535] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 960b9480-1a74-45ed-ba3b-4c9311dd370c is going to be updated. [ 699.392203] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.392203] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.392203] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.392203] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.392203] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.401664] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 960b9480-1a74-45ed-ba3b-4c9311dd370c in Status: IN_PROGRESS for 2s [ 699.529711] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('83648dc4-e98f-47b1-b96c-2c0a05ebae74',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.036625] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.036963] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.036963] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.037217] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.037217] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.037432] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 83648dc4-e98f-47b1-b96c-2c0a05ebae74 is going to be created. [ 700.070776] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.070921] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.070921] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.071149] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.071316] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.084335] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83648dc4-e98f-47b1-b96c-2c0a05ebae74 in Status: UNINITIALIZED for 2s [ 700.422569] env[65065]: INFO networking_nsxv3.common.synchronization [None req-e0470652-2f60-4572-9bf9-620f8ded130e None None] Enqueued Resource ID: f205d0d9-a1f4-4a28-9d2a-4ae899737b13 with Priority: HIGHEST for action port [ 700.423128] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f205d0d9-a1f4-4a28-9d2a-4ae899737b13 with Priority: HIGHEST for action port [ 700.423634] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-f205d0d9-a1f4-4a28-9d2a-4ae899737b13 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.423828] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f205d0d9-a1f4-4a28-9d2a-4ae899737b13" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.423904] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f205d0d9-a1f4-4a28-9d2a-4ae899737b13" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.424281] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f205d0d9-a1f4-4a28-9d2a-4ae899737b13" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.424403] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f205d0d9-a1f4-4a28-9d2a-4ae899737b13',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.927837] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f205d0d9-a1f4-4a28-9d2a-4ae899737b13 [ 700.928133] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.928301] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.928370] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.928633] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.928789] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.928911] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f205d0d9-a1f4-4a28-9d2a-4ae899737b13 already deleted. [ 700.929075] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f205d0d9-a1f4-4a28-9d2a-4ae899737b13" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.052947] env[65065]: INFO networking_nsxv3.common.synchronization [req-dfb7954b-6495-404d-91d3-180c328fdca1 req-63550266-aa1e-48de-909e-f4537741e58b tempest-ServersTestBootFromVolume-1803684170 tempest-ServersTestBootFromVolume-1803684170-project-member] Enqueued Resource ID: adad9983-8e2e-4bac-8155-8a076b03abc3 with Priority: HIGHEST for action security_group_members [ 701.053556] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adad9983-8e2e-4bac-8155-8a076b03abc3 with Priority: HIGHEST for action security_group_members [ 701.053884] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-adad9983-8e2e-4bac-8155-8a076b03abc3 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.054017] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adad9983-8e2e-4bac-8155-8a076b03abc3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.054552] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adad9983-8e2e-4bac-8155-8a076b03abc3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.054814] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adad9983-8e2e-4bac-8155-8a076b03abc3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.054992] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.055106] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.055171] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.059353] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.059453] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.059557] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('adad9983-8e2e-4bac-8155-8a076b03abc3',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.415951] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 960b9480-1a74-45ed-ba3b-4c9311dd370c in Status: SUCCESS [ 701.416382] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 960b9480-1a74-45ed-ba3b-4c9311dd370c deletion is rescheduled due to dependency. [ 701.416617] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-960b9480-1a74-45ed-ba3b-4c9311dd370c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.449129] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock network-192 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.449129] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "network-192" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.449129] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "network-192" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.452147] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "network-192" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.452147] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.452147] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.452147] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.452147] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.452147] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.452147] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 701.452147] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 701.452147] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 701.452147] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 701.452147] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 701.452147] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 701.452147] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 701.480369] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 701.480593] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 701.480733] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 701.481301] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "network-192" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.481436] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock port-9fd9dc27-8a03-4511-975e-97c83c140e94 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.481646] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "port-9fd9dc27-8a03-4511-975e-97c83c140e94" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.481795] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "port-9fd9dc27-8a03-4511-975e-97c83c140e94" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.482353] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "port-9fd9dc27-8a03-4511-975e-97c83c140e94" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.482514] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9fd9dc27-8a03-4511-975e-97c83c140e94',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.562326] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.562692] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.562692] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.563287] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.563287] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.563666] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.563802] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.564631] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.564631] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.564631] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.564631] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: adad9983-8e2e-4bac-8155-8a076b03abc3 already deleted. [ 701.564631] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adad9983-8e2e-4bac-8155-8a076b03abc3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.985693] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.986068] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.986208] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.986671] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.986842] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.987069] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Segment Port 9fd9dc27-8a03-4511-975e-97c83c140e94 not found, creating... [ 701.987466] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.987707] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.987938] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.989239] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.989600] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.990309] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.990441] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.990831] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.991189] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.992638] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.993816] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Resource: SegmentPort with ID: 9fd9dc27-8a03-4511-975e-97c83c140e94 is going to be created. [ 702.017167] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.017355] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.017474] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.017741] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.018043] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.018925] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "port-9fd9dc27-8a03-4511-975e-97c83c140e94" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.102222] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83648dc4-e98f-47b1-b96c-2c0a05ebae74 in Status: SUCCESS [ 702.102562] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83648dc4-e98f-47b1-b96c-2c0a05ebae74" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.102719] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83648dc4-e98f-47b1-b96c-2c0a05ebae74" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.103032] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83648dc4-e98f-47b1-b96c-2c0a05ebae74" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.103605] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.103729] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.103729] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.104304] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.104304] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.104304] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83648dc4-e98f-47b1-b96c-2c0a05ebae74" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.104602] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('83648dc4-e98f-47b1-b96c-2c0a05ebae74',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.230267] env[65065]: INFO networking_nsxv3.common.synchronization [None req-541b1b5e-8486-46a8-8b9c-df7257420ae6 None None] Enqueued Resource ID: 051a335a-dede-4293-951a-5ba56b6c9dc4 with Priority: HIGHEST for action port [ 702.230267] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 051a335a-dede-4293-951a-5ba56b6c9dc4 with Priority: HIGHEST for action port [ 702.231039] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-051a335a-dede-4293-951a-5ba56b6c9dc4 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.231186] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-051a335a-dede-4293-951a-5ba56b6c9dc4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.231282] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-051a335a-dede-4293-951a-5ba56b6c9dc4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.232077] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-051a335a-dede-4293-951a-5ba56b6c9dc4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.232361] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('051a335a-dede-4293-951a-5ba56b6c9dc4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.608432] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-83648dc4-e98f-47b1-b96c-2c0a05ebae74 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.608610] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83648dc4-e98f-47b1-b96c-2c0a05ebae74" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.608649] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83648dc4-e98f-47b1-b96c-2c0a05ebae74" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.608902] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83648dc4-e98f-47b1-b96c-2c0a05ebae74" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.609120] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.609227] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.609286] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.609440] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.609527] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.609613] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83648dc4-e98f-47b1-b96c-2c0a05ebae74" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.609755] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-83648dc4-e98f-47b1-b96c-2c0a05ebae74 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.609845] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83648dc4-e98f-47b1-b96c-2c0a05ebae74" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.609906] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83648dc4-e98f-47b1-b96c-2c0a05ebae74" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.610054] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83648dc4-e98f-47b1-b96c-2c0a05ebae74" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.613677] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.613677] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.613677] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.613677] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.613677] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.613677] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83648dc4-e98f-47b1-b96c-2c0a05ebae74" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.613677] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('83648dc4-e98f-47b1-b96c-2c0a05ebae74',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.735458] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 051a335a-dede-4293-951a-5ba56b6c9dc4 [ 702.735762] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.735942] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.736065] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.736315] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.736438] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.736630] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:051a335a-dede-4293-951a-5ba56b6c9dc4 already deleted. [ 702.736698] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-051a335a-dede-4293-951a-5ba56b6c9dc4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.797033] env[65065]: INFO networking_nsxv3.common.synchronization [req-dfb7954b-6495-404d-91d3-180c328fdca1 req-e69f753a-d706-4721-a296-5203a25a3d7c service nova] Enqueued Resource ID: adad9983-8e2e-4bac-8155-8a076b03abc3 with Priority: HIGHEST for action security_group_rules [ 702.797033] env[65065]: INFO networking_nsxv3.common.synchronization [req-dfb7954b-6495-404d-91d3-180c328fdca1 req-e69f753a-d706-4721-a296-5203a25a3d7c service nova] Enqueued Resource ID: adad9983-8e2e-4bac-8155-8a076b03abc3 with Priority: HIGHEST for action security_group_members [ 702.797033] env[65065]: INFO networking_nsxv3.common.synchronization [req-dfb7954b-6495-404d-91d3-180c328fdca1 req-e69f753a-d706-4721-a296-5203a25a3d7c service nova] Enqueued Resource ID: 9fd9dc27-8a03-4511-975e-97c83c140e94 with Priority: HIGHEST for action port [ 702.798336] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adad9983-8e2e-4bac-8155-8a076b03abc3 with Priority: HIGHEST for action security_group_rules [ 702.798336] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adad9983-8e2e-4bac-8155-8a076b03abc3 with Priority: HIGHEST for action security_group_members [ 702.798336] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9fd9dc27-8a03-4511-975e-97c83c140e94 with Priority: HIGHEST for action port [ 702.798336] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-adad9983-8e2e-4bac-8155-8a076b03abc3 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.798336] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-adad9983-8e2e-4bac-8155-8a076b03abc3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.798905] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-adad9983-8e2e-4bac-8155-8a076b03abc3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.798905] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-adad9983-8e2e-4bac-8155-8a076b03abc3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.799535] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('adad9983-8e2e-4bac-8155-8a076b03abc3',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.800311] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-adad9983-8e2e-4bac-8155-8a076b03abc3 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.800507] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adad9983-8e2e-4bac-8155-8a076b03abc3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.800633] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adad9983-8e2e-4bac-8155-8a076b03abc3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.800907] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adad9983-8e2e-4bac-8155-8a076b03abc3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.801353] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.801353] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.801353] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.801579] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.801718] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.801856] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('adad9983-8e2e-4bac-8155-8a076b03abc3',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.802878] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-9fd9dc27-8a03-4511-975e-97c83c140e94 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.802878] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9fd9dc27-8a03-4511-975e-97c83c140e94" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.802878] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9fd9dc27-8a03-4511-975e-97c83c140e94" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.803122] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9fd9dc27-8a03-4511-975e-97c83c140e94" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.803389] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9fd9dc27-8a03-4511-975e-97c83c140e94',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.113206] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 83648dc4-e98f-47b1-b96c-2c0a05ebae74: rpc.has_security_group_logging(os_id): False [ 703.134838] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.135026] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.135069] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.135273] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.135362] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.135565] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.135661] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.135723] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.135899] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.135978] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.136174] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.136269] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.136330] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.136476] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.136551] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.136742] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.136834] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.136895] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.137044] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.137119] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.137203] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 83648dc4-e98f-47b1-b96c-2c0a05ebae74 is going to be created. [ 703.201406] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.201530] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.201604] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.201846] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.202046] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.216441] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 83648dc4-e98f-47b1-b96c-2c0a05ebae74 in Status: IN_PROGRESS for 2s [ 703.305130] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-adad9983-8e2e-4bac-8155-8a076b03abc3 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.305756] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adad9983-8e2e-4bac-8155-8a076b03abc3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.305756] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('adad9983-8e2e-4bac-8155-8a076b03abc3',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.306444] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9fd9dc27-8a03-4511-975e-97c83c140e94 with status ACTIVE [ 703.306632] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.307871] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.307987] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.308356] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.308356] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.309081] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.309081] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.309160] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.309346] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.309446] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.310516] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.310516] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.310516] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.310516] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.310516] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.310516] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9fd9dc27-8a03-4511-975e-97c83c140e94 is going to be updated. [ 703.318016] env[65065]: INFO networking_nsxv3.common.synchronization [None req-66e398b7-ec85-4c11-bc14-9a3bf555db6e None None] Enqueued Resource ID: 44202174-cc08-4382-98ca-961ab6566251 with Priority: HIGHEST for action port [ 703.318649] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44202174-cc08-4382-98ca-961ab6566251 with Priority: HIGHEST for action port [ 703.319505] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-44202174-cc08-4382-98ca-961ab6566251 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.319505] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-44202174-cc08-4382-98ca-961ab6566251" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.319505] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-44202174-cc08-4382-98ca-961ab6566251" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.319661] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-44202174-cc08-4382-98ca-961ab6566251" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.319661] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('44202174-cc08-4382-98ca-961ab6566251',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.345564] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.345753] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.345927] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.346245] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.346448] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.346617] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9fd9dc27-8a03-4511-975e-97c83c140e94" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.530217] env[65065]: INFO networking_nsxv3.common.synchronization [req-fb733c7b-b1a9-4726-98ce-6cf94471ff8c req-6c0e45bd-2733-4888-9dbf-6dfc7802d9a5 tempest-ImagesTestJSON-1714479415 tempest-ImagesTestJSON-1714479415-project-member] Enqueued Resource ID: e6d7baac-4bff-46b9-b88d-2dc982621c0f with Priority: HIGHEST for action security_group_members [ 703.530217] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6d7baac-4bff-46b9-b88d-2dc982621c0f with Priority: HIGHEST for action security_group_members [ 703.530217] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6d7baac-4bff-46b9-b88d-2dc982621c0f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.530217] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.530217] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.530217] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.530217] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.530217] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.530217] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.530823] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.531104] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.531558] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e6d7baac-4bff-46b9-b88d-2dc982621c0f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.815644] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('adad9983-8e2e-4bac-8155-8a076b03abc3',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.823325] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 44202174-cc08-4382-98ca-961ab6566251 [ 703.823325] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.823325] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.823325] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.823325] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.823649] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.823811] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:44202174-cc08-4382-98ca-961ab6566251 already deleted. [ 703.823959] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-44202174-cc08-4382-98ca-961ab6566251" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.884923] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock network-582 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.885332] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "network-582" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.885332] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "network-582" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.885564] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "network-582" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.885958] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.886224] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.886392] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.886607] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.886751] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.886959] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 703.887072] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 703.887180] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 703.887294] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 703.887378] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 703.887495] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 703.887645] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 703.909083] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 703.909307] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 703.909383] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 703.909550] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "network-582" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.909859] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock port-0ca51cf7-4faa-44b7-a59c-ddf85f6e5368 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.910037] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "port-0ca51cf7-4faa-44b7-a59c-ddf85f6e5368" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.910247] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "port-0ca51cf7-4faa-44b7-a59c-ddf85f6e5368" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.910584] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "port-0ca51cf7-4faa-44b7-a59c-ddf85f6e5368" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.910717] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0ca51cf7-4faa-44b7-a59c-ddf85f6e5368',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.034536] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.034679] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.034761] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.034961] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.035053] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.035301] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.035414] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.035414] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.035553] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.035620] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.035720] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6d7baac-4bff-46b9-b88d-2dc982621c0f is going to be updated. [ 704.072128] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.072314] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.072390] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.073284] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.073284] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.085177] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6d7baac-4bff-46b9-b88d-2dc982621c0f in Status: IN_PROGRESS for 2s [ 704.316574] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.317036] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.317036] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.317147] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.317179] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.317499] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: adad9983-8e2e-4bac-8155-8a076b03abc3 is going to be created. [ 704.345915] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.346225] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.346225] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.346429] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.346563] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.360421] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: adad9983-8e2e-4bac-8155-8a076b03abc3 in Status: UNINITIALIZED for 2s [ 704.413024] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.413355] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.413788] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.414241] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.414471] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.414636] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Segment Port 0ca51cf7-4faa-44b7-a59c-ddf85f6e5368 not found, creating... [ 704.415020] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.415217] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.415381] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.415694] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.415881] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.416533] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.416533] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.416807] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.416988] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.417161] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.417329] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Resource: SegmentPort with ID: 0ca51cf7-4faa-44b7-a59c-ddf85f6e5368 is going to be created. [ 704.446238] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.446957] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.446957] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.446957] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.447192] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.447344] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "port-0ca51cf7-4faa-44b7-a59c-ddf85f6e5368" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.504841] env[65065]: INFO networking_nsxv3.common.synchronization [None req-9add78ed-fdac-4a0f-a653-09080e631eef None None] Enqueued Resource ID: fe5f1374-b728-45ae-ad62-b2919f7ce22d with Priority: HIGHEST for action port [ 704.505598] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe5f1374-b728-45ae-ad62-b2919f7ce22d with Priority: HIGHEST for action port [ 704.506174] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-fe5f1374-b728-45ae-ad62-b2919f7ce22d taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.506413] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fe5f1374-b728-45ae-ad62-b2919f7ce22d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.506535] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fe5f1374-b728-45ae-ad62-b2919f7ce22d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.507168] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fe5f1374-b728-45ae-ad62-b2919f7ce22d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.507334] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fe5f1374-b728-45ae-ad62-b2919f7ce22d',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.010533] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fe5f1374-b728-45ae-ad62-b2919f7ce22d [ 705.010533] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.010833] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.010833] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.010972] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.011085] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.011361] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fe5f1374-b728-45ae-ad62-b2919f7ce22d already deleted. [ 705.011361] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fe5f1374-b728-45ae-ad62-b2919f7ce22d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.170223] env[65065]: INFO networking_nsxv3.common.synchronization [req-fb733c7b-b1a9-4726-98ce-6cf94471ff8c req-024e2587-ed1a-4169-995b-6e540c1792a2 service nova] Enqueued Resource ID: e6d7baac-4bff-46b9-b88d-2dc982621c0f with Priority: HIGHEST for action security_group_rules [ 705.170332] env[65065]: INFO networking_nsxv3.common.synchronization [req-fb733c7b-b1a9-4726-98ce-6cf94471ff8c req-024e2587-ed1a-4169-995b-6e540c1792a2 service nova] Enqueued Resource ID: e6d7baac-4bff-46b9-b88d-2dc982621c0f with Priority: HIGHEST for action security_group_members [ 705.170628] env[65065]: INFO networking_nsxv3.common.synchronization [req-fb733c7b-b1a9-4726-98ce-6cf94471ff8c req-024e2587-ed1a-4169-995b-6e540c1792a2 service nova] Enqueued Resource ID: 0ca51cf7-4faa-44b7-a59c-ddf85f6e5368 with Priority: HIGHEST for action port [ 705.171398] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6d7baac-4bff-46b9-b88d-2dc982621c0f with Priority: HIGHEST for action security_group_rules [ 705.171642] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6d7baac-4bff-46b9-b88d-2dc982621c0f with Priority: HIGHEST for action security_group_members [ 705.171834] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ca51cf7-4faa-44b7-a59c-ddf85f6e5368 with Priority: HIGHEST for action port [ 705.172291] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e6d7baac-4bff-46b9-b88d-2dc982621c0f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.172537] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.172679] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.172940] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.173113] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e6d7baac-4bff-46b9-b88d-2dc982621c0f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.174231] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6d7baac-4bff-46b9-b88d-2dc982621c0f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.174333] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.174529] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-0ca51cf7-4faa-44b7-a59c-ddf85f6e5368 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.175697] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0ca51cf7-4faa-44b7-a59c-ddf85f6e5368" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.175697] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0ca51cf7-4faa-44b7-a59c-ddf85f6e5368" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.175844] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0ca51cf7-4faa-44b7-a59c-ddf85f6e5368" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.176265] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0ca51cf7-4faa-44b7-a59c-ddf85f6e5368',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.228647] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 83648dc4-e98f-47b1-b96c-2c0a05ebae74 in Status: SUCCESS [ 705.228647] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-83648dc4-e98f-47b1-b96c-2c0a05ebae74" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.677727] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6d7baac-4bff-46b9-b88d-2dc982621c0f taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.678275] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.679323] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0ca51cf7-4faa-44b7-a59c-ddf85f6e5368 with status ACTIVE [ 705.679513] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.679633] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.679703] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.679914] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.680010] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.680207] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.680310] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.680378] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.680537] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.680612] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.680785] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.680891] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.680933] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.681072] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.681145] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.681227] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0ca51cf7-4faa-44b7-a59c-ddf85f6e5368 is going to be updated. [ 705.705757] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.706035] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.706134] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.706420] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.706512] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.706894] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0ca51cf7-4faa-44b7-a59c-ddf85f6e5368" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.071648] env[65065]: INFO networking_nsxv3.common.synchronization [req-cf1b6b0f-f655-4180-85b5-e2f4be1cde4c req-686debb7-7316-4d5c-9fb5-6ff10b7a6efd tempest-ServersWithSpecificFlavorTestJSON-1007896152 tempest-ServersWithSpecificFlavorTestJSON-1007896152-project-member] Enqueued Resource ID: 9576b45f-b344-47bd-8f8b-9df4c3725ddb with Priority: HIGHEST for action security_group_members [ 706.072276] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9576b45f-b344-47bd-8f8b-9df4c3725ddb with Priority: HIGHEST for action security_group_members [ 706.073852] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-9576b45f-b344-47bd-8f8b-9df4c3725ddb taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.074071] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9576b45f-b344-47bd-8f8b-9df4c3725ddb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.074071] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9576b45f-b344-47bd-8f8b-9df4c3725ddb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.074280] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9576b45f-b344-47bd-8f8b-9df4c3725ddb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.074497] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.074660] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.074755] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.074944] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.075045] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.075176] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9576b45f-b344-47bd-8f8b-9df4c3725ddb',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.101865] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6d7baac-4bff-46b9-b88d-2dc982621c0f in Status: SUCCESS [ 706.102152] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6d7baac-4bff-46b9-b88d-2dc982621c0f deletion is rescheduled due to dependency. [ 706.102284] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.102482] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.102724] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.103107] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.103245] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.103313] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.103536] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.103605] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.103665] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e6d7baac-4bff-46b9-b88d-2dc982621c0f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.205043] env[65065]: INFO networking_nsxv3.common.synchronization [None req-c82b47f0-ed0c-4364-ac1d-140e2759ebaa tempest-MigrationsAdminTest-1843927703 tempest-MigrationsAdminTest-1843927703-project-member] Enqueued Resource ID: 07d79860-fd26-4dc9-9109-d29aa65b45ab with Priority: HIGHEST for action security_group_rules [ 706.205229] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07d79860-fd26-4dc9-9109-d29aa65b45ab with Priority: HIGHEST for action security_group_rules [ 706.206310] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-07d79860-fd26-4dc9-9109-d29aa65b45ab taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.206544] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-07d79860-fd26-4dc9-9109-d29aa65b45ab" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.206682] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-07d79860-fd26-4dc9-9109-d29aa65b45ab" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.207042] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-07d79860-fd26-4dc9-9109-d29aa65b45ab" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.207213] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('07d79860-fd26-4dc9-9109-d29aa65b45ab',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.338357] env[65065]: INFO networking_nsxv3.common.synchronization [None req-291ed994-da86-4fb6-ab87-1035b48db1f4 tempest-MigrationsAdminTest-1843927703 tempest-MigrationsAdminTest-1843927703-project-member] Enqueued Resource ID: 07d79860-fd26-4dc9-9109-d29aa65b45ab with Priority: HIGHEST for action security_group_rules [ 706.339376] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07d79860-fd26-4dc9-9109-d29aa65b45ab with Priority: HIGHEST for action security_group_rules [ 706.339688] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-07d79860-fd26-4dc9-9109-d29aa65b45ab taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.339688] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-07d79860-fd26-4dc9-9109-d29aa65b45ab" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.382107] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: adad9983-8e2e-4bac-8155-8a076b03abc3 in Status: SUCCESS [ 706.382325] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adad9983-8e2e-4bac-8155-8a076b03abc3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.382476] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adad9983-8e2e-4bac-8155-8a076b03abc3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.382696] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adad9983-8e2e-4bac-8155-8a076b03abc3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.382895] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.383070] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.383126] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.383257] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.383380] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.383434] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adad9983-8e2e-4bac-8155-8a076b03abc3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.383557] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('adad9983-8e2e-4bac-8155-8a076b03abc3',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.532073] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock network-487 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.532274] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "network-487" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.532390] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "network-487" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.532682] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "network-487" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.532897] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.533063] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.533192] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.533448] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.533587] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.533787] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 706.533892] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 706.533993] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 706.534108] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 706.534223] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 706.534327] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 706.534458] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 706.557502] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 706.557662] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 706.557793] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 706.558106] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "network-487" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.558363] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock port-382ebb10-8073-473e-9200-aea4a7ce5190 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.558527] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "port-382ebb10-8073-473e-9200-aea4a7ce5190" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.558639] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "port-382ebb10-8073-473e-9200-aea4a7ce5190" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.558957] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "port-382ebb10-8073-473e-9200-aea4a7ce5190" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.559352] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('382ebb10-8073-473e-9200-aea4a7ce5190',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.577181] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.577321] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.577392] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.577589] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.577681] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.578007] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.578089] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.578129] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.578256] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.578384] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.578424] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9576b45f-b344-47bd-8f8b-9df4c3725ddb is going to be updated. [ 706.603369] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.603511] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.604164] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.604164] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.604164] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.606741] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e6d7baac-4bff-46b9-b88d-2dc982621c0f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.614232] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9576b45f-b344-47bd-8f8b-9df4c3725ddb in Status: IN_PROGRESS for 2s [ 706.727876] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.728268] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.728366] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.732021] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.732021] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.732021] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 07d79860-fd26-4dc9-9109-d29aa65b45ab already deleted. [ 706.732021] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-07d79860-fd26-4dc9-9109-d29aa65b45ab" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.732021] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-07d79860-fd26-4dc9-9109-d29aa65b45ab" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.732021] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-07d79860-fd26-4dc9-9109-d29aa65b45ab" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.732021] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('07d79860-fd26-4dc9-9109-d29aa65b45ab',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.886583] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('adad9983-8e2e-4bac-8155-8a076b03abc3',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.063982] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.063982] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.063982] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.063982] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.063982] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.063982] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Segment Port 382ebb10-8073-473e-9200-aea4a7ce5190 not found, creating... [ 707.063982] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.063982] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.063982] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.063982] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.063982] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.064577] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.064577] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.065072] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.065521] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.065800] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.066096] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Resource: SegmentPort with ID: 382ebb10-8073-473e-9200-aea4a7ce5190 is going to be created. [ 707.088222] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.088469] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.088469] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.088654] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.088850] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.089096] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "port-382ebb10-8073-473e-9200-aea4a7ce5190" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.111133] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e6d7baac-4bff-46b9-b88d-2dc982621c0f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.269460] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.269460] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.269460] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.269769] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.269820] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.270272] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 07d79860-fd26-4dc9-9109-d29aa65b45ab already deleted. [ 707.270272] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-07d79860-fd26-4dc9-9109-d29aa65b45ab" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.389363] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for adad9983-8e2e-4bac-8155-8a076b03abc3: rpc.has_security_group_logging(os_id): False [ 707.419139] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.419497] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.419497] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.419650] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.419792] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.420023] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.420197] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.420238] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.420376] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.420461] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.420601] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: adad9983-8e2e-4bac-8155-8a076b03abc3 is going to be created. [ 707.488848] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.489066] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.489066] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.489281] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.489470] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.502851] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: adad9983-8e2e-4bac-8155-8a076b03abc3 in Status: IN_PROGRESS for 2s [ 707.615365] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.615444] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.615516] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.615737] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.615841] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.615949] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6d7baac-4bff-46b9-b88d-2dc982621c0f is going to be updated. [ 707.644078] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.644237] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.644280] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.644518] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.644663] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.654208] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6d7baac-4bff-46b9-b88d-2dc982621c0f in Status: IN_PROGRESS for 2s [ 707.846342] env[65065]: INFO networking_nsxv3.common.synchronization [req-cf1b6b0f-f655-4180-85b5-e2f4be1cde4c req-dd527083-36a1-4de6-b6e1-2e21cb2c45df service nova] Enqueued Resource ID: 9576b45f-b344-47bd-8f8b-9df4c3725ddb with Priority: HIGHEST for action security_group_rules [ 707.846342] env[65065]: INFO networking_nsxv3.common.synchronization [req-cf1b6b0f-f655-4180-85b5-e2f4be1cde4c req-dd527083-36a1-4de6-b6e1-2e21cb2c45df service nova] Enqueued Resource ID: 9576b45f-b344-47bd-8f8b-9df4c3725ddb with Priority: HIGHEST for action security_group_members [ 707.846342] env[65065]: INFO networking_nsxv3.common.synchronization [req-cf1b6b0f-f655-4180-85b5-e2f4be1cde4c req-dd527083-36a1-4de6-b6e1-2e21cb2c45df service nova] Enqueued Resource ID: 382ebb10-8073-473e-9200-aea4a7ce5190 with Priority: HIGHEST for action port [ 707.846879] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9576b45f-b344-47bd-8f8b-9df4c3725ddb with Priority: HIGHEST for action security_group_rules [ 707.848043] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9576b45f-b344-47bd-8f8b-9df4c3725ddb with Priority: HIGHEST for action security_group_members [ 707.848043] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 382ebb10-8073-473e-9200-aea4a7ce5190 with Priority: HIGHEST for action port [ 707.848043] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9576b45f-b344-47bd-8f8b-9df4c3725ddb taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.848043] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9576b45f-b344-47bd-8f8b-9df4c3725ddb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.848043] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9576b45f-b344-47bd-8f8b-9df4c3725ddb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.848043] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9576b45f-b344-47bd-8f8b-9df4c3725ddb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.848043] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9576b45f-b344-47bd-8f8b-9df4c3725ddb',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.851589] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-9576b45f-b344-47bd-8f8b-9df4c3725ddb taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.851589] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9576b45f-b344-47bd-8f8b-9df4c3725ddb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.851589] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-382ebb10-8073-473e-9200-aea4a7ce5190 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.851589] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-382ebb10-8073-473e-9200-aea4a7ce5190" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.851589] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-382ebb10-8073-473e-9200-aea4a7ce5190" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.851589] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-382ebb10-8073-473e-9200-aea4a7ce5190" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.851589] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('382ebb10-8073-473e-9200-aea4a7ce5190',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.352651] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-9576b45f-b344-47bd-8f8b-9df4c3725ddb taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.353039] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9576b45f-b344-47bd-8f8b-9df4c3725ddb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.353344] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 382ebb10-8073-473e-9200-aea4a7ce5190 with status ACTIVE [ 708.353530] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.353643] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.353709] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.353949] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.354040] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.355941] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.356144] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.356222] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.356420] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.356507] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.356700] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.356807] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.356871] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.357043] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.357122] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.358380] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 382ebb10-8073-473e-9200-aea4a7ce5190 is going to be updated. [ 708.382391] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.382391] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.382391] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.382777] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.382931] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.383443] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-382ebb10-8073-473e-9200-aea4a7ce5190" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.625546] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9576b45f-b344-47bd-8f8b-9df4c3725ddb in Status: SUCCESS [ 708.625770] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9576b45f-b344-47bd-8f8b-9df4c3725ddb deletion is rescheduled due to dependency. [ 708.626395] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9576b45f-b344-47bd-8f8b-9df4c3725ddb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.626395] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9576b45f-b344-47bd-8f8b-9df4c3725ddb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.626395] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9576b45f-b344-47bd-8f8b-9df4c3725ddb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.626557] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.626686] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.626686] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.626847] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.627404] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.627632] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9576b45f-b344-47bd-8f8b-9df4c3725ddb',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.639223] env[65065]: INFO networking_nsxv3.common.synchronization [req-cfae52ab-ec2e-416c-ac62-0a4c3a3fe7e2 req-4242c397-9ef8-4ddf-b6ee-eec9efa28666 tempest-SecurityGroupRulesTestJSON-1358109699 tempest-SecurityGroupRulesTestJSON-1358109699-project-member] Enqueued Resource ID: 7454c983-8f12-4870-b7ef-f47af6caec18 with Priority: HIGHEST for action security_group_rules [ 708.639924] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7454c983-8f12-4870-b7ef-f47af6caec18 with Priority: HIGHEST for action security_group_rules [ 708.639994] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7454c983-8f12-4870-b7ef-f47af6caec18 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.640109] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7454c983-8f12-4870-b7ef-f47af6caec18" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.640273] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7454c983-8f12-4870-b7ef-f47af6caec18" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.640398] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7454c983-8f12-4870-b7ef-f47af6caec18" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.640477] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7454c983-8f12-4870-b7ef-f47af6caec18',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.130627] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9576b45f-b344-47bd-8f8b-9df4c3725ddb',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.162033] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.162178] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.162266] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.162457] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.162541] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.162630] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7454c983-8f12-4870-b7ef-f47af6caec18 already deleted. [ 709.162763] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7454c983-8f12-4870-b7ef-f47af6caec18" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.516671] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: adad9983-8e2e-4bac-8155-8a076b03abc3 in Status: SUCCESS [ 709.516671] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-adad9983-8e2e-4bac-8155-8a076b03abc3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.633640] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9576b45f-b344-47bd-8f8b-9df4c3725ddb',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.667036] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6d7baac-4bff-46b9-b88d-2dc982621c0f in Status: SUCCESS [ 709.667272] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.667475] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.667712] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.667968] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.668172] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.668275] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.668612] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.668612] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.668612] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.669870] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e6d7baac-4bff-46b9-b88d-2dc982621c0f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.136798] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.137139] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.137228] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.137514] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.137591] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.137726] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9576b45f-b344-47bd-8f8b-9df4c3725ddb is going to be updated. [ 710.171840] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6d7baac-4bff-46b9-b88d-2dc982621c0f taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.171840] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.171840] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.172781] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.172781] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.172781] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.172781] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.172781] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.172948] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.172978] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.173257] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6d7baac-4bff-46b9-b88d-2dc982621c0f taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.173356] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.173410] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.173617] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.173792] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.173928] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.175353] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.175637] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.175758] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.175887] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.176028] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e6d7baac-4bff-46b9-b88d-2dc982621c0f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.181220] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.181395] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.181488] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.181753] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.181941] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.192948] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9576b45f-b344-47bd-8f8b-9df4c3725ddb in Status: IN_PROGRESS for 2s [ 710.681435] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e6d7baac-4bff-46b9-b88d-2dc982621c0f: rpc.has_security_group_logging(os_id): False [ 710.702402] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.702402] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.702504] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.702672] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.702764] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.702995] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.703891] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.703891] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.703891] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.703891] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.703891] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.703891] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.703891] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.703891] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.704142] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.704258] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.704361] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.704440] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.704566] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.704642] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.704727] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e6d7baac-4bff-46b9-b88d-2dc982621c0f is going to be updated. [ 710.772738] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.772738] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.772738] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.772738] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.772738] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.786558] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e6d7baac-4bff-46b9-b88d-2dc982621c0f in Status: IN_PROGRESS for 2s [ 711.037935] env[65065]: INFO networking_nsxv3.common.synchronization [None req-f35bf0d7-88ac-4ee7-b783-c456e9384e71 None None] Enqueued Resource ID: ab391dbd-d718-4af0-a35d-f28ee381f19a with Priority: HIGHEST for action port [ 711.043338] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab391dbd-d718-4af0-a35d-f28ee381f19a with Priority: HIGHEST for action port [ 711.046141] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-ab391dbd-d718-4af0-a35d-f28ee381f19a taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.046141] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ab391dbd-d718-4af0-a35d-f28ee381f19a" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.046141] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ab391dbd-d718-4af0-a35d-f28ee381f19a" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.047691] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ab391dbd-d718-4af0-a35d-f28ee381f19a" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.047691] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ab391dbd-d718-4af0-a35d-f28ee381f19a',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.544360] env[65065]: INFO networking_nsxv3.common.synchronization [req-074cc344-7fee-45a4-8e2e-6594c7a72396 req-e4a16b58-a06d-4e5d-9e43-c21a9828499f tempest-ServersTestJSON-528503202 tempest-ServersTestJSON-528503202-project-member] Enqueued Resource ID: 16e2d0aa-9161-41ee-99b8-486218dfa51d with Priority: HIGHEST for action security_group_members [ 711.544897] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16e2d0aa-9161-41ee-99b8-486218dfa51d with Priority: HIGHEST for action security_group_members [ 711.545364] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-16e2d0aa-9161-41ee-99b8-486218dfa51d taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.545493] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16e2d0aa-9161-41ee-99b8-486218dfa51d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.545608] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16e2d0aa-9161-41ee-99b8-486218dfa51d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.546131] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16e2d0aa-9161-41ee-99b8-486218dfa51d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.546491] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.546628] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.546718] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.546903] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.547025] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.547167] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('16e2d0aa-9161-41ee-99b8-486218dfa51d',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.554830] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ab391dbd-d718-4af0-a35d-f28ee381f19a [ 711.555085] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.555216] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.555283] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.555482] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.555567] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.555655] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ab391dbd-d718-4af0-a35d-f28ee381f19a already deleted. [ 711.555732] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ab391dbd-d718-4af0-a35d-f28ee381f19a" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.055319] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.055319] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.055319] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.055319] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.055319] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.055319] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.055319] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.055319] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.055319] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.055319] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.055319] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16e2d0aa-9161-41ee-99b8-486218dfa51d is going to be updated. [ 712.087686] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.088203] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.089568] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.089895] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.091860] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.101981] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16e2d0aa-9161-41ee-99b8-486218dfa51d in Status: IN_PROGRESS for 2s [ 712.117026] env[65065]: INFO networking_nsxv3.common.synchronization [req-af0af0a7-478e-4fa1-b69f-f4d3d0333891 req-d1ac8bc2-b2d7-45c0-b138-869386fce6bd tempest-ServerDiskConfigTestJSON-975440465 tempest-ServerDiskConfigTestJSON-975440465-project-member] Enqueued Resource ID: ffd44fac-c762-408c-862b-ccea34e00947 with Priority: HIGHEST for action security_group_members [ 712.117026] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ffd44fac-c762-408c-862b-ccea34e00947 with Priority: HIGHEST for action security_group_members [ 712.117026] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-ffd44fac-c762-408c-862b-ccea34e00947 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.117449] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.117636] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.117967] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.120558] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.120558] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.120558] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.120558] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.120558] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.120558] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ffd44fac-c762-408c-862b-ccea34e00947',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.206897] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9576b45f-b344-47bd-8f8b-9df4c3725ddb in Status: SUCCESS [ 712.206897] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9576b45f-b344-47bd-8f8b-9df4c3725ddb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.208580] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9576b45f-b344-47bd-8f8b-9df4c3725ddb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.208580] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9576b45f-b344-47bd-8f8b-9df4c3725ddb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.208580] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.208749] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.208853] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.209587] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.209755] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.209898] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9576b45f-b344-47bd-8f8b-9df4c3725ddb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.210247] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9576b45f-b344-47bd-8f8b-9df4c3725ddb',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.621972] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.622433] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.622433] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.622506] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.622562] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.622756] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.622868] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.622934] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.623099] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.623178] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.623263] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ffd44fac-c762-408c-862b-ccea34e00947 is going to be updated. [ 712.649596] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.650161] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.650161] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.650161] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.650324] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.661510] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ffd44fac-c762-408c-862b-ccea34e00947 in Status: IN_PROGRESS for 2s [ 712.714495] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9576b45f-b344-47bd-8f8b-9df4c3725ddb',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.800160] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e6d7baac-4bff-46b9-b88d-2dc982621c0f in Status: SUCCESS [ 712.800402] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.996142] env[65065]: INFO networking_nsxv3.common.synchronization [req-7aaa1bcd-10bc-46e4-a580-3e474c21b5c7 req-6622395a-fbef-4c86-b991-38945d693587 tempest-ServersTestFqdnHostnames-735698162 tempest-ServersTestFqdnHostnames-735698162-project-member] Enqueued Resource ID: 36775ca6-e5c8-4c23-bad8-a30192db7f3f with Priority: HIGHEST for action security_group_members [ 712.996617] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 36775ca6-e5c8-4c23-bad8-a30192db7f3f with Priority: HIGHEST for action security_group_members [ 712.996774] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-36775ca6-e5c8-4c23-bad8-a30192db7f3f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.997627] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-36775ca6-e5c8-4c23-bad8-a30192db7f3f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.997927] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-36775ca6-e5c8-4c23-bad8-a30192db7f3f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.998173] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-36775ca6-e5c8-4c23-bad8-a30192db7f3f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.998407] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.998498] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.998636] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.998797] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.999093] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.999093] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('36775ca6-e5c8-4c23-bad8-a30192db7f3f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.221046] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9576b45f-b344-47bd-8f8b-9df4c3725ddb: rpc.has_security_group_logging(os_id): False [ 713.252224] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.252224] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.252224] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.252224] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.252224] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.252224] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.252224] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.252224] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.252224] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.252224] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.252224] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9576b45f-b344-47bd-8f8b-9df4c3725ddb is going to be updated. [ 713.327269] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.327269] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.327269] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.327269] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.327786] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.345580] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9576b45f-b344-47bd-8f8b-9df4c3725ddb in Status: IN_PROGRESS for 2s [ 713.502928] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.502928] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.502928] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.504171] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.504311] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.504503] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.504610] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.504676] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.504850] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.504928] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.505095] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 36775ca6-e5c8-4c23-bad8-a30192db7f3f is going to be updated. [ 713.541719] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.542431] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.542431] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.542431] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.542431] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.554145] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 36775ca6-e5c8-4c23-bad8-a30192db7f3f in Status: IN_PROGRESS for 2s [ 713.849609] env[65065]: INFO networking_nsxv3.common.synchronization [None req-b6b7df85-76ae-448a-a18c-32069f6ad98e None None] Enqueued Resource ID: 6ac9bdf6-6989-48ef-b4ab-ddea727f46f1 with Priority: HIGHEST for action port [ 713.849866] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ac9bdf6-6989-48ef-b4ab-ddea727f46f1 with Priority: HIGHEST for action port [ 713.850093] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-6ac9bdf6-6989-48ef-b4ab-ddea727f46f1 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.850217] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6ac9bdf6-6989-48ef-b4ab-ddea727f46f1" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.850291] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6ac9bdf6-6989-48ef-b4ab-ddea727f46f1" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.850636] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6ac9bdf6-6989-48ef-b4ab-ddea727f46f1" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.850636] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6ac9bdf6-6989-48ef-b4ab-ddea727f46f1',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.113872] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16e2d0aa-9161-41ee-99b8-486218dfa51d in Status: SUCCESS [ 714.113872] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16e2d0aa-9161-41ee-99b8-486218dfa51d deletion is rescheduled due to dependency. [ 714.113872] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16e2d0aa-9161-41ee-99b8-486218dfa51d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.356617] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6ac9bdf6-6989-48ef-b4ab-ddea727f46f1 [ 714.356763] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.356870] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.356870] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.357370] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.357497] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.357829] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6ac9bdf6-6989-48ef-b4ab-ddea727f46f1 already deleted. [ 714.357829] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6ac9bdf6-6989-48ef-b4ab-ddea727f46f1" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.673859] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ffd44fac-c762-408c-862b-ccea34e00947 in Status: SUCCESS [ 714.674145] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ffd44fac-c762-408c-862b-ccea34e00947 deletion is rescheduled due to dependency. [ 714.674311] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.831615] env[65065]: INFO networking_nsxv3.common.synchronization [req-3c36e742-037a-4ac5-9dce-5db3995e4a34 req-04a9cfaa-0be8-4326-a333-0d47cc6056f2 tempest-SecurityGroupRulesTestJSON-1358109699 tempest-SecurityGroupRulesTestJSON-1358109699-project-member] Enqueued Resource ID: c8cf32f8-ae60-4971-b2ed-82009550288a with Priority: HIGHEST for action security_group_rules [ 714.832258] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8cf32f8-ae60-4971-b2ed-82009550288a with Priority: HIGHEST for action security_group_rules [ 714.833185] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c8cf32f8-ae60-4971-b2ed-82009550288a taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.833367] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c8cf32f8-ae60-4971-b2ed-82009550288a" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.833367] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c8cf32f8-ae60-4971-b2ed-82009550288a" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.833857] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c8cf32f8-ae60-4971-b2ed-82009550288a" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.833951] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c8cf32f8-ae60-4971-b2ed-82009550288a',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.357235] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.357235] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.357235] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.357684] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.357684] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.357684] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c8cf32f8-ae60-4971-b2ed-82009550288a already deleted. [ 715.357797] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c8cf32f8-ae60-4971-b2ed-82009550288a" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.366744] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9576b45f-b344-47bd-8f8b-9df4c3725ddb in Status: SUCCESS [ 715.366744] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9576b45f-b344-47bd-8f8b-9df4c3725ddb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.565925] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 36775ca6-e5c8-4c23-bad8-a30192db7f3f in Status: SUCCESS [ 715.566151] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 36775ca6-e5c8-4c23-bad8-a30192db7f3f deletion is rescheduled due to dependency. [ 715.566264] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-36775ca6-e5c8-4c23-bad8-a30192db7f3f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.158902] env[65065]: INFO networking_nsxv3.common.synchronization [req-20af8d05-4981-4cf0-b088-a81d37ec1ab3 req-f0685a17-253d-49eb-804e-f19251f80be2 tempest-ServersAdminNegativeTestJSON-568589506 tempest-ServersAdminNegativeTestJSON-568589506-project-member] Enqueued Resource ID: cc04914d-716e-49e1-8a77-946f904f69bb with Priority: HIGHEST for action security_group_members [ 716.158902] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc04914d-716e-49e1-8a77-946f904f69bb with Priority: HIGHEST for action security_group_members [ 716.160780] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc04914d-716e-49e1-8a77-946f904f69bb taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.160780] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc04914d-716e-49e1-8a77-946f904f69bb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.160780] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc04914d-716e-49e1-8a77-946f904f69bb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.160780] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc04914d-716e-49e1-8a77-946f904f69bb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.160780] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.161637] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.161637] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.161637] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.161637] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.161637] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc04914d-716e-49e1-8a77-946f904f69bb',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.663849] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cc04914d-716e-49e1-8a77-946f904f69bb',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.167465] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cc04914d-716e-49e1-8a77-946f904f69bb',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.676633] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.677066] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.677066] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.677359] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.677464] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.677570] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc04914d-716e-49e1-8a77-946f904f69bb is going to be updated. [ 717.718833] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.719095] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.719203] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.719403] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.719567] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.732746] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc04914d-716e-49e1-8a77-946f904f69bb in Status: IN_PROGRESS for 2s [ 718.177076] env[65065]: INFO networking_nsxv3.common.synchronization [req-5031087c-c0a4-4fdb-8eec-8b961cac811d req-cda90e85-6777-4cda-b2f5-9eed7daf4723 tempest-ImagesOneServerTestJSON-427268011 tempest-ImagesOneServerTestJSON-427268011-project-member] Enqueued Resource ID: c264aab4-0245-4fdf-8152-a3476b7dd553 with Priority: HIGHEST for action security_group_members [ 718.177620] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c264aab4-0245-4fdf-8152-a3476b7dd553 with Priority: HIGHEST for action security_group_members [ 718.178155] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-c264aab4-0245-4fdf-8152-a3476b7dd553 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.178449] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c264aab4-0245-4fdf-8152-a3476b7dd553" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.179081] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c264aab4-0245-4fdf-8152-a3476b7dd553" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.179081] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c264aab4-0245-4fdf-8152-a3476b7dd553" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.179081] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.179464] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.179464] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.179464] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.179464] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.179606] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c264aab4-0245-4fdf-8152-a3476b7dd553',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.683213] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.683514] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.683514] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.683668] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.683749] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.685791] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.685791] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.685791] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.685791] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.685791] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.685791] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c264aab4-0245-4fdf-8152-a3476b7dd553 is going to be updated. [ 718.716379] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.716566] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.716652] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.716862] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.718097] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.727559] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c264aab4-0245-4fdf-8152-a3476b7dd553 in Status: IN_PROGRESS for 2s [ 718.925734] env[65065]: INFO networking_nsxv3.common.synchronization [req-5c1b5c89-6673-4261-a68d-409be2f0eb59 req-6af794aa-44e0-4124-8e2c-300488e89bea tempest-SecurityGroupRulesTestJSON-1358109699 tempest-SecurityGroupRulesTestJSON-1358109699-project-member] Enqueued Resource ID: 2e587261-5f92-446b-be9c-0df5d4b52887 with Priority: HIGHEST for action security_group_rules [ 718.926373] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e587261-5f92-446b-be9c-0df5d4b52887 with Priority: HIGHEST for action security_group_rules [ 718.926683] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2e587261-5f92-446b-be9c-0df5d4b52887 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.926804] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2e587261-5f92-446b-be9c-0df5d4b52887" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.926869] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2e587261-5f92-446b-be9c-0df5d4b52887" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.927191] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2e587261-5f92-446b-be9c-0df5d4b52887" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.927279] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2e587261-5f92-446b-be9c-0df5d4b52887',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.448499] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.448678] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.448732] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.448949] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.449056] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.449150] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2e587261-5f92-446b-be9c-0df5d4b52887 already deleted. [ 719.449232] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2e587261-5f92-446b-be9c-0df5d4b52887" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.677843] env[65065]: INFO networking_nsxv3.common.synchronization [req-b26c3280-5274-48aa-9a3f-6798a4cb87de req-089d63ed-d1ad-43f4-bf30-08ed58ba3833 tempest-SecurityGroupRulesTestJSON-1358109699 tempest-SecurityGroupRulesTestJSON-1358109699-project-member] Enqueued Resource ID: 2e587261-5f92-446b-be9c-0df5d4b52887 with Priority: HIGHEST for action security_group_rules [ 719.677843] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e587261-5f92-446b-be9c-0df5d4b52887 with Priority: HIGHEST for action security_group_rules [ 719.678634] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2e587261-5f92-446b-be9c-0df5d4b52887 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.678964] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2e587261-5f92-446b-be9c-0df5d4b52887" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.679231] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2e587261-5f92-446b-be9c-0df5d4b52887" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.679725] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2e587261-5f92-446b-be9c-0df5d4b52887" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.679952] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2e587261-5f92-446b-be9c-0df5d4b52887',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.752315] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc04914d-716e-49e1-8a77-946f904f69bb in Status: SUCCESS [ 719.752315] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc04914d-716e-49e1-8a77-946f904f69bb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.153602] env[65065]: INFO networking_nsxv3.common.synchronization [req-a503a5bf-cdc4-4c91-9c3f-b2e64a284a98 req-28a8e811-a262-4b68-abac-2955b50de11f tempest-ServerTagsTestJSON-1316947547 tempest-ServerTagsTestJSON-1316947547-project-member] Enqueued Resource ID: e4ff6072-a232-4ebe-b049-2085dcef5991 with Priority: HIGHEST for action security_group_members [ 720.154264] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4ff6072-a232-4ebe-b049-2085dcef5991 with Priority: HIGHEST for action security_group_members [ 720.154647] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4ff6072-a232-4ebe-b049-2085dcef5991 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.154782] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4ff6072-a232-4ebe-b049-2085dcef5991" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.155764] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4ff6072-a232-4ebe-b049-2085dcef5991" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.155764] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4ff6072-a232-4ebe-b049-2085dcef5991" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.155764] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.155764] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.155764] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.155764] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.155764] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.155764] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e4ff6072-a232-4ebe-b049-2085dcef5991',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.212019] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.212250] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.212250] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.212490] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.212605] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.212731] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2e587261-5f92-446b-be9c-0df5d4b52887 already deleted. [ 720.212818] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2e587261-5f92-446b-be9c-0df5d4b52887" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.663116] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.663116] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.663116] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.663116] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.663116] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.663116] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.663116] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.663116] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.663116] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.663116] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.663116] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e4ff6072-a232-4ebe-b049-2085dcef5991 is going to be updated. [ 720.693850] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.693850] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.693850] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.693850] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.693850] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.702246] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4ff6072-a232-4ebe-b049-2085dcef5991 in Status: IN_PROGRESS for 2s [ 720.739096] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c264aab4-0245-4fdf-8152-a3476b7dd553 in Status: SUCCESS [ 720.739096] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c264aab4-0245-4fdf-8152-a3476b7dd553 deletion is rescheduled due to dependency. [ 720.739096] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c264aab4-0245-4fdf-8152-a3476b7dd553" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.041447] env[65065]: INFO networking_nsxv3.common.synchronization [req-faf703c6-360e-4a47-aa34-e889d5fd7da0 req-f77d0bc9-e490-4bd8-85a1-15a7831b98a6 tempest-ServerAddressesTestJSON-290914398 tempest-ServerAddressesTestJSON-290914398-project-member] Enqueued Resource ID: 4473193a-198b-4342-a9ef-a1966ddd9441 with Priority: HIGHEST for action security_group_members [ 721.041447] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4473193a-198b-4342-a9ef-a1966ddd9441 with Priority: HIGHEST for action security_group_members [ 721.041447] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-4473193a-198b-4342-a9ef-a1966ddd9441 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.042066] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4473193a-198b-4342-a9ef-a1966ddd9441" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.042257] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4473193a-198b-4342-a9ef-a1966ddd9441" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.042600] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4473193a-198b-4342-a9ef-a1966ddd9441" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.044243] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.044243] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.044243] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.044243] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.044243] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.044243] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4473193a-198b-4342-a9ef-a1966ddd9441',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.458873] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock network-801 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.459362] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "network-801" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.459434] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "network-801" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.459694] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "network-801" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.460314] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.460490] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.460745] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.460993] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.461369] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.461369] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 721.462092] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 721.462092] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 721.462092] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 721.462358] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 721.462358] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 721.462414] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 721.483096] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 721.483554] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 721.483554] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 721.483554] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "network-801" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.483805] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock port-4d910023-c32e-41b4-9102-89b731927928 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.483979] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "port-4d910023-c32e-41b4-9102-89b731927928" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.484124] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "port-4d910023-c32e-41b4-9102-89b731927928" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.484441] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "port-4d910023-c32e-41b4-9102-89b731927928" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.484814] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4d910023-c32e-41b4-9102-89b731927928',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.547143] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.547549] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.547666] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.547904] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.548141] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.548633] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.548763] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.548876] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.549231] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.549314] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.549404] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4473193a-198b-4342-a9ef-a1966ddd9441 already deleted. [ 721.549482] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4473193a-198b-4342-a9ef-a1966ddd9441" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.989104] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.989347] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.989503] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.989886] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.989948] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.991649] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Segment Port 4d910023-c32e-41b4-9102-89b731927928 not found, creating... [ 721.991649] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.991649] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.991649] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.991649] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.991649] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.991649] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.991649] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.991649] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.992054] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.992054] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.992156] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Resource: SegmentPort with ID: 4d910023-c32e-41b4-9102-89b731927928 is going to be created. [ 722.016231] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.016467] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.016568] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.016869] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.017122] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.017749] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "port-4d910023-c32e-41b4-9102-89b731927928" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.717150] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4ff6072-a232-4ebe-b049-2085dcef5991 in Status: SUCCESS [ 722.717150] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e4ff6072-a232-4ebe-b049-2085dcef5991 deletion is rescheduled due to dependency. [ 722.717150] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4ff6072-a232-4ebe-b049-2085dcef5991" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.758228] env[65065]: INFO networking_nsxv3.common.synchronization [req-faf703c6-360e-4a47-aa34-e889d5fd7da0 req-f713280c-344b-484b-b77d-6f3fe5d67692 service nova] Enqueued Resource ID: 4473193a-198b-4342-a9ef-a1966ddd9441 with Priority: HIGHEST for action security_group_rules [ 722.758228] env[65065]: INFO networking_nsxv3.common.synchronization [req-faf703c6-360e-4a47-aa34-e889d5fd7da0 req-f713280c-344b-484b-b77d-6f3fe5d67692 service nova] Enqueued Resource ID: 4473193a-198b-4342-a9ef-a1966ddd9441 with Priority: HIGHEST for action security_group_members [ 722.758406] env[65065]: INFO networking_nsxv3.common.synchronization [req-faf703c6-360e-4a47-aa34-e889d5fd7da0 req-f713280c-344b-484b-b77d-6f3fe5d67692 service nova] Enqueued Resource ID: 4d910023-c32e-41b4-9102-89b731927928 with Priority: HIGHEST for action port [ 722.758912] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4473193a-198b-4342-a9ef-a1966ddd9441 with Priority: HIGHEST for action security_group_rules [ 722.759252] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4473193a-198b-4342-a9ef-a1966ddd9441 with Priority: HIGHEST for action security_group_members [ 722.759387] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d910023-c32e-41b4-9102-89b731927928 with Priority: HIGHEST for action port [ 722.759679] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4473193a-198b-4342-a9ef-a1966ddd9441 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.759796] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4473193a-198b-4342-a9ef-a1966ddd9441" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.759861] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4473193a-198b-4342-a9ef-a1966ddd9441" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.760188] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4473193a-198b-4342-a9ef-a1966ddd9441" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.760284] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4473193a-198b-4342-a9ef-a1966ddd9441',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.761506] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-4473193a-198b-4342-a9ef-a1966ddd9441 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.761643] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4473193a-198b-4342-a9ef-a1966ddd9441" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.761734] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4473193a-198b-4342-a9ef-a1966ddd9441" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.762260] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4473193a-198b-4342-a9ef-a1966ddd9441" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.762260] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.762455] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.762455] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.762611] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.762703] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.762835] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4473193a-198b-4342-a9ef-a1966ddd9441',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.764113] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-4d910023-c32e-41b4-9102-89b731927928 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.764113] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4d910023-c32e-41b4-9102-89b731927928" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.764113] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4d910023-c32e-41b4-9102-89b731927928" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.764563] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4d910023-c32e-41b4-9102-89b731927928" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.764563] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4d910023-c32e-41b4-9102-89b731927928',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.930575] env[65065]: INFO networking_nsxv3.common.synchronization [req-db8f1958-509c-4cae-afac-0751583014a3 req-09f0f5fc-09e5-4bdf-b005-b6b093bb9059 tempest-SecurityGroupRulesTestJSON-1358109699 tempest-SecurityGroupRulesTestJSON-1358109699-project-member] Enqueued Resource ID: 2e587261-5f92-446b-be9c-0df5d4b52887 with Priority: HIGHEST for action security_group_rules [ 722.931145] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e587261-5f92-446b-be9c-0df5d4b52887 with Priority: HIGHEST for action security_group_rules [ 722.931300] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2e587261-5f92-446b-be9c-0df5d4b52887 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.931426] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2e587261-5f92-446b-be9c-0df5d4b52887" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.931486] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2e587261-5f92-446b-be9c-0df5d4b52887" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.931787] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2e587261-5f92-446b-be9c-0df5d4b52887" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.931787] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2e587261-5f92-446b-be9c-0df5d4b52887',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.267622] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4d910023-c32e-41b4-9102-89b731927928 with status ACTIVE [ 723.268252] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.268252] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.268252] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.268634] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.268634] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.268634] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.268741] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.268741] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.269201] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.269201] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.269347] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.269347] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.269435] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.269611] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.269611] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.269705] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4d910023-c32e-41b4-9102-89b731927928 is going to be updated. [ 723.271101] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-4473193a-198b-4342-a9ef-a1966ddd9441 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.271192] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4473193a-198b-4342-a9ef-a1966ddd9441" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.272193] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4473193a-198b-4342-a9ef-a1966ddd9441',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.299015] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.299209] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.299261] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.299459] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.299588] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.300698] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4d910023-c32e-41b4-9102-89b731927928" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.363873] env[65065]: INFO networking_nsxv3.common.synchronization [req-3f8cc06e-b70b-4d73-a886-0e4cc009c4ed req-f962fdb0-3a18-4e98-8aae-299df892d1e1 tempest-ImagesNegativeTestJSON-279276685 tempest-ImagesNegativeTestJSON-279276685-project-member] Enqueued Resource ID: 620bfc73-f8be-4924-840f-8cc06371ccef with Priority: HIGHEST for action security_group_members [ 723.364504] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 620bfc73-f8be-4924-840f-8cc06371ccef with Priority: HIGHEST for action security_group_members [ 723.365506] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-620bfc73-f8be-4924-840f-8cc06371ccef taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.365506] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-620bfc73-f8be-4924-840f-8cc06371ccef" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.365506] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-620bfc73-f8be-4924-840f-8cc06371ccef" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.365745] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-620bfc73-f8be-4924-840f-8cc06371ccef" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.366171] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.366171] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.366171] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.366383] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.366980] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.366980] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('620bfc73-f8be-4924-840f-8cc06371ccef',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.461888] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.462567] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.462567] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.462567] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.462567] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.462567] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2e587261-5f92-446b-be9c-0df5d4b52887 already deleted. [ 723.462830] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2e587261-5f92-446b-be9c-0df5d4b52887" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.745774] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock network-336 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.746100] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "network-336" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.746201] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "network-336" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.746511] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "network-336" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.746761] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.746910] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.747040] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.747284] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.747388] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.747582] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 723.747688] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 723.747946] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 723.748108] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 723.748223] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 723.748325] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 723.748452] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 723.768437] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 723.768597] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 723.768729] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 723.768896] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "network-336" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.769265] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock port-aebede3c-a22c-471f-afbf-452050a3d917 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.769445] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "port-aebede3c-a22c-471f-afbf-452050a3d917" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.769558] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "port-aebede3c-a22c-471f-afbf-452050a3d917" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.769872] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "port-aebede3c-a22c-471f-afbf-452050a3d917" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.770011] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aebede3c-a22c-471f-afbf-452050a3d917',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.773995] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4473193a-198b-4342-a9ef-a1966ddd9441',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.869738] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.869891] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.870046] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.870228] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.870371] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.870560] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.870659] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.870714] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.870874] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.870952] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.871051] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 620bfc73-f8be-4924-840f-8cc06371ccef already deleted. [ 723.871143] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-620bfc73-f8be-4924-840f-8cc06371ccef" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.272764] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.272973] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.273086] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.273371] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.273515] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.273685] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Segment Port aebede3c-a22c-471f-afbf-452050a3d917 not found, creating... [ 724.274065] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.274239] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.274355] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.275543] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.275683] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.276130] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.276296] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.276410] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.276649] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.276782] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.276918] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Resource: SegmentPort with ID: aebede3c-a22c-471f-afbf-452050a3d917 is going to be created. [ 724.278411] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.278467] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.278547] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.278689] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.279207] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.279207] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4473193a-198b-4342-a9ef-a1966ddd9441 is going to be created. [ 724.299368] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.300023] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.300023] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.300023] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.300211] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.300476] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "port-aebede3c-a22c-471f-afbf-452050a3d917" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.304259] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.304382] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.304474] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.304627] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.304772] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.318478] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4473193a-198b-4342-a9ef-a1966ddd9441 in Status: UNINITIALIZED for 2s [ 725.116164] env[65065]: INFO networking_nsxv3.common.synchronization [req-3f8cc06e-b70b-4d73-a886-0e4cc009c4ed req-a3f72654-ae36-4b9c-a98b-3fe9e6218ae1 service nova] Enqueued Resource ID: 620bfc73-f8be-4924-840f-8cc06371ccef with Priority: HIGHEST for action security_group_rules [ 725.116510] env[65065]: INFO networking_nsxv3.common.synchronization [req-3f8cc06e-b70b-4d73-a886-0e4cc009c4ed req-a3f72654-ae36-4b9c-a98b-3fe9e6218ae1 service nova] Enqueued Resource ID: 620bfc73-f8be-4924-840f-8cc06371ccef with Priority: HIGHEST for action security_group_members [ 725.117481] env[65065]: INFO networking_nsxv3.common.synchronization [req-3f8cc06e-b70b-4d73-a886-0e4cc009c4ed req-a3f72654-ae36-4b9c-a98b-3fe9e6218ae1 service nova] Enqueued Resource ID: aebede3c-a22c-471f-afbf-452050a3d917 with Priority: HIGHEST for action port [ 725.117481] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 620bfc73-f8be-4924-840f-8cc06371ccef with Priority: HIGHEST for action security_group_rules [ 725.117632] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 620bfc73-f8be-4924-840f-8cc06371ccef with Priority: HIGHEST for action security_group_members [ 725.117746] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aebede3c-a22c-471f-afbf-452050a3d917 with Priority: HIGHEST for action port [ 725.118918] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-620bfc73-f8be-4924-840f-8cc06371ccef taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.118918] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-620bfc73-f8be-4924-840f-8cc06371ccef" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.118918] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-620bfc73-f8be-4924-840f-8cc06371ccef" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.118918] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-620bfc73-f8be-4924-840f-8cc06371ccef" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.119166] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('620bfc73-f8be-4924-840f-8cc06371ccef',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.124723] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-620bfc73-f8be-4924-840f-8cc06371ccef taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.124723] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-620bfc73-f8be-4924-840f-8cc06371ccef" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.124723] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-620bfc73-f8be-4924-840f-8cc06371ccef" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.124723] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-620bfc73-f8be-4924-840f-8cc06371ccef" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.124723] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.124723] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.124723] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.124723] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.124723] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.124723] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('620bfc73-f8be-4924-840f-8cc06371ccef',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.126129] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-aebede3c-a22c-471f-afbf-452050a3d917 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.126129] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aebede3c-a22c-471f-afbf-452050a3d917" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.126129] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aebede3c-a22c-471f-afbf-452050a3d917" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.126129] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aebede3c-a22c-471f-afbf-452050a3d917" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.126129] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aebede3c-a22c-471f-afbf-452050a3d917',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.625881] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('620bfc73-f8be-4924-840f-8cc06371ccef',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.629916] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-620bfc73-f8be-4924-840f-8cc06371ccef taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.629916] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-620bfc73-f8be-4924-840f-8cc06371ccef" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.635022] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port aebede3c-a22c-471f-afbf-452050a3d917 with status ACTIVE [ 725.635022] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.635022] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.635022] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.635022] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.635022] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.635022] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.635022] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.635022] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.635022] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.635022] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.635022] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.635022] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.635022] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.635022] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.635022] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.635022] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: aebede3c-a22c-471f-afbf-452050a3d917 is going to be updated. [ 725.668911] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.672568] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.672568] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.672568] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.672568] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.672568] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aebede3c-a22c-471f-afbf-452050a3d917" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.128926] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('620bfc73-f8be-4924-840f-8cc06371ccef',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.335946] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4473193a-198b-4342-a9ef-a1966ddd9441 in Status: SUCCESS [ 726.336249] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4473193a-198b-4342-a9ef-a1966ddd9441" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.336843] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4473193a-198b-4342-a9ef-a1966ddd9441" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.336843] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4473193a-198b-4342-a9ef-a1966ddd9441" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.336998] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.337090] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.338046] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.338046] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.338046] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.338046] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4473193a-198b-4342-a9ef-a1966ddd9441" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.338046] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4473193a-198b-4342-a9ef-a1966ddd9441',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.634200] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.634435] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.634533] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.634816] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.635090] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.635164] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 620bfc73-f8be-4924-840f-8cc06371ccef is going to be created. [ 726.665923] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.666132] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.666225] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.666499] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.666701] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.679243] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 620bfc73-f8be-4924-840f-8cc06371ccef in Status: UNINITIALIZED for 2s [ 726.842758] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-4473193a-198b-4342-a9ef-a1966ddd9441 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.842758] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4473193a-198b-4342-a9ef-a1966ddd9441" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.842957] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4473193a-198b-4342-a9ef-a1966ddd9441" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.843066] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4473193a-198b-4342-a9ef-a1966ddd9441" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.843330] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.843415] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.843452] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.843617] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.844241] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.844528] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4473193a-198b-4342-a9ef-a1966ddd9441" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.844751] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-4473193a-198b-4342-a9ef-a1966ddd9441 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.844851] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4473193a-198b-4342-a9ef-a1966ddd9441" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.844918] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4473193a-198b-4342-a9ef-a1966ddd9441" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.845154] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4473193a-198b-4342-a9ef-a1966ddd9441" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.845301] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.845397] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.845465] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.848074] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.848074] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.848074] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4473193a-198b-4342-a9ef-a1966ddd9441" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.848074] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4473193a-198b-4342-a9ef-a1966ddd9441',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.852385] env[65065]: INFO networking_nsxv3.common.synchronization [req-6b5f9e2e-d51e-4019-9b20-4bc544fea898 req-48c651b2-ff07-47d4-a034-222d01165873 tempest-ServerRescueTestJSONUnderV235-262437214 tempest-ServerRescueTestJSONUnderV235-262437214-project-member] Enqueued Resource ID: 83648dc4-e98f-47b1-b96c-2c0a05ebae74 with Priority: HIGHEST for action security_group_members [ 726.852385] env[65065]: INFO networking_nsxv3.common.synchronization [req-6b5f9e2e-d51e-4019-9b20-4bc544fea898 req-48c651b2-ff07-47d4-a034-222d01165873 tempest-ServerRescueTestJSONUnderV235-262437214 tempest-ServerRescueTestJSONUnderV235-262437214-project-member] Enqueued Resource ID: 1b385f63-63eb-4c26-8064-58a7fa9195f5 with Priority: HIGHEST for action security_group_members [ 726.855013] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83648dc4-e98f-47b1-b96c-2c0a05ebae74 with Priority: HIGHEST for action security_group_members [ 726.855013] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b385f63-63eb-4c26-8064-58a7fa9195f5 with Priority: HIGHEST for action security_group_members [ 726.855013] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-83648dc4-e98f-47b1-b96c-2c0a05ebae74 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.855013] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83648dc4-e98f-47b1-b96c-2c0a05ebae74" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.855013] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83648dc4-e98f-47b1-b96c-2c0a05ebae74" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.855013] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83648dc4-e98f-47b1-b96c-2c0a05ebae74" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.855013] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.855438] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.855438] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.855438] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.855438] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.855596] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('83648dc4-e98f-47b1-b96c-2c0a05ebae74',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.857847] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b385f63-63eb-4c26-8064-58a7fa9195f5 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.857847] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b385f63-63eb-4c26-8064-58a7fa9195f5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.857847] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b385f63-63eb-4c26-8064-58a7fa9195f5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.857847] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b385f63-63eb-4c26-8064-58a7fa9195f5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.857847] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.857847] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.857847] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.857847] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.857847] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.857847] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1b385f63-63eb-4c26-8064-58a7fa9195f5',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.921027] env[65065]: INFO networking_nsxv3.common.synchronization [req-6b5f9e2e-d51e-4019-9b20-4bc544fea898 req-48c651b2-ff07-47d4-a034-222d01165873 tempest-ServerRescueTestJSONUnderV235-262437214 tempest-ServerRescueTestJSONUnderV235-262437214-project-member] Enqueued Resource ID: 1b385f63-63eb-4c26-8064-58a7fa9195f5 with Priority: HIGHEST for action security_group_rules [ 726.921027] env[65065]: INFO networking_nsxv3.common.synchronization [req-6b5f9e2e-d51e-4019-9b20-4bc544fea898 req-48c651b2-ff07-47d4-a034-222d01165873 tempest-ServerRescueTestJSONUnderV235-262437214 tempest-ServerRescueTestJSONUnderV235-262437214-project-member] Enqueued Resource ID: 1b385f63-63eb-4c26-8064-58a7fa9195f5 with Priority: HIGHEST for action security_group_members [ 726.921027] env[65065]: INFO networking_nsxv3.common.synchronization [req-6b5f9e2e-d51e-4019-9b20-4bc544fea898 req-48c651b2-ff07-47d4-a034-222d01165873 tempest-ServerRescueTestJSONUnderV235-262437214 tempest-ServerRescueTestJSONUnderV235-262437214-project-member] Enqueued Resource ID: 83648dc4-e98f-47b1-b96c-2c0a05ebae74 with Priority: HIGHEST for action security_group_rules [ 726.921027] env[65065]: INFO networking_nsxv3.common.synchronization [req-6b5f9e2e-d51e-4019-9b20-4bc544fea898 req-48c651b2-ff07-47d4-a034-222d01165873 tempest-ServerRescueTestJSONUnderV235-262437214 tempest-ServerRescueTestJSONUnderV235-262437214-project-member] Enqueued Resource ID: 83648dc4-e98f-47b1-b96c-2c0a05ebae74 with Priority: HIGHEST for action security_group_members [ 726.921027] env[65065]: INFO networking_nsxv3.common.synchronization [req-6b5f9e2e-d51e-4019-9b20-4bc544fea898 req-48c651b2-ff07-47d4-a034-222d01165873 tempest-ServerRescueTestJSONUnderV235-262437214 tempest-ServerRescueTestJSONUnderV235-262437214-project-member] Enqueued Resource ID: ba9173ab-6222-47e3-b895-afd2fa79a40c with Priority: HIGHEST for action port [ 726.922510] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b385f63-63eb-4c26-8064-58a7fa9195f5 with Priority: HIGHEST for action security_group_rules [ 726.924470] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83648dc4-e98f-47b1-b96c-2c0a05ebae74 with Priority: HIGHEST for action security_group_rules [ 726.924470] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba9173ab-6222-47e3-b895-afd2fa79a40c with Priority: HIGHEST for action port [ 726.924470] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b385f63-63eb-4c26-8064-58a7fa9195f5 with Priority: HIGHEST for action security_group_members [ 726.924470] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83648dc4-e98f-47b1-b96c-2c0a05ebae74 with Priority: HIGHEST for action security_group_members [ 726.924470] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1b385f63-63eb-4c26-8064-58a7fa9195f5 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.924470] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1b385f63-63eb-4c26-8064-58a7fa9195f5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.924470] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1b385f63-63eb-4c26-8064-58a7fa9195f5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.924932] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1b385f63-63eb-4c26-8064-58a7fa9195f5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.924932] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1b385f63-63eb-4c26-8064-58a7fa9195f5',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.926769] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-83648dc4-e98f-47b1-b96c-2c0a05ebae74 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.927115] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-83648dc4-e98f-47b1-b96c-2c0a05ebae74" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.927531] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-83648dc4-e98f-47b1-b96c-2c0a05ebae74" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.928228] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-83648dc4-e98f-47b1-b96c-2c0a05ebae74" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.928345] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('83648dc4-e98f-47b1-b96c-2c0a05ebae74',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.929598] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-ba9173ab-6222-47e3-b895-afd2fa79a40c taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.929787] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ba9173ab-6222-47e3-b895-afd2fa79a40c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.929868] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ba9173ab-6222-47e3-b895-afd2fa79a40c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.930141] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ba9173ab-6222-47e3-b895-afd2fa79a40c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.930229] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ba9173ab-6222-47e3-b895-afd2fa79a40c',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.931129] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b385f63-63eb-4c26-8064-58a7fa9195f5 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.931238] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b385f63-63eb-4c26-8064-58a7fa9195f5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.931437] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-83648dc4-e98f-47b1-b96c-2c0a05ebae74 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.931536] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83648dc4-e98f-47b1-b96c-2c0a05ebae74" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.354653] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4473193a-198b-4342-a9ef-a1966ddd9441: rpc.has_security_group_logging(os_id): False [ 727.360277] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('83648dc4-e98f-47b1-b96c-2c0a05ebae74',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.361615] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1b385f63-63eb-4c26-8064-58a7fa9195f5',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.382329] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.382483] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.382608] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.382843] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.382942] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.383174] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.383276] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.383340] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.383515] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.383593] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.383993] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.383993] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.383993] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.384190] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.384190] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.384374] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.384491] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.384551] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.384692] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.384766] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.384869] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4473193a-198b-4342-a9ef-a1966ddd9441 is going to be created. [ 727.433176] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-83648dc4-e98f-47b1-b96c-2c0a05ebae74 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.433335] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83648dc4-e98f-47b1-b96c-2c0a05ebae74" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.433607] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b385f63-63eb-4c26-8064-58a7fa9195f5 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.433713] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b385f63-63eb-4c26-8064-58a7fa9195f5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.433892] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ba9173ab-6222-47e3-b895-afd2fa79a40c with status ACTIVE [ 727.434093] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.434255] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.434329] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.434579] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.434677] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.434850] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.434948] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.435095] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.435257] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.435405] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.435624] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.435804] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.435804] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.435953] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.436077] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.436244] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ba9173ab-6222-47e3-b895-afd2fa79a40c is going to be updated. [ 727.483973] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.484190] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.484427] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.484508] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.484626] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.484869] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ba9173ab-6222-47e3-b895-afd2fa79a40c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.519625] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.519872] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.519872] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.520119] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.520235] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.544495] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4473193a-198b-4342-a9ef-a1966ddd9441 in Status: IN_PROGRESS for 2s [ 727.865550] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1b385f63-63eb-4c26-8064-58a7fa9195f5',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.866078] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('83648dc4-e98f-47b1-b96c-2c0a05ebae74',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.370049] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.371719] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.371719] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.371719] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.371719] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.371719] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1b385f63-63eb-4c26-8064-58a7fa9195f5 is going to be created. [ 728.376355] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.376355] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.376355] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.376355] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.376355] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.376355] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 83648dc4-e98f-47b1-b96c-2c0a05ebae74 is going to be updated. [ 728.403162] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.403368] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.403440] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.403678] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.403867] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.412089] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.412252] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.412339] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.412571] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.412740] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.418067] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1b385f63-63eb-4c26-8064-58a7fa9195f5 in Status: UNINITIALIZED for 2s [ 728.426420] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83648dc4-e98f-47b1-b96c-2c0a05ebae74 in Status: IN_PROGRESS for 2s [ 728.692171] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 620bfc73-f8be-4924-840f-8cc06371ccef in Status: SUCCESS [ 728.692171] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-620bfc73-f8be-4924-840f-8cc06371ccef" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.692171] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-620bfc73-f8be-4924-840f-8cc06371ccef" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.692171] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-620bfc73-f8be-4924-840f-8cc06371ccef" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.692171] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.692171] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.692171] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.692171] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.692171] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.692171] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-620bfc73-f8be-4924-840f-8cc06371ccef" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.692171] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('620bfc73-f8be-4924-840f-8cc06371ccef',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.797827] env[65065]: INFO networking_nsxv3.common.synchronization [req-eb5caf03-30b8-4e35-b83c-21055b693e20 req-3a02143f-b695-4fd6-ba2e-6b88ec098098 tempest-ServerRescueTestJSONUnderV235-262437214 tempest-ServerRescueTestJSONUnderV235-262437214-project-member] Enqueued Resource ID: 83648dc4-e98f-47b1-b96c-2c0a05ebae74 with Priority: HIGHEST for action security_group_members [ 728.797827] env[65065]: INFO networking_nsxv3.common.synchronization [req-eb5caf03-30b8-4e35-b83c-21055b693e20 req-3a02143f-b695-4fd6-ba2e-6b88ec098098 tempest-ServerRescueTestJSONUnderV235-262437214 tempest-ServerRescueTestJSONUnderV235-262437214-project-member] Enqueued Resource ID: 1b385f63-63eb-4c26-8064-58a7fa9195f5 with Priority: HIGHEST for action security_group_members [ 728.797827] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83648dc4-e98f-47b1-b96c-2c0a05ebae74 with Priority: HIGHEST for action security_group_members [ 728.797827] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b385f63-63eb-4c26-8064-58a7fa9195f5 with Priority: HIGHEST for action security_group_members [ 728.797827] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-83648dc4-e98f-47b1-b96c-2c0a05ebae74 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.797827] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83648dc4-e98f-47b1-b96c-2c0a05ebae74" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.797827] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b385f63-63eb-4c26-8064-58a7fa9195f5 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.797827] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b385f63-63eb-4c26-8064-58a7fa9195f5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.875264] env[65065]: INFO networking_nsxv3.common.synchronization [req-eb5caf03-30b8-4e35-b83c-21055b693e20 req-3a02143f-b695-4fd6-ba2e-6b88ec098098 tempest-ServerRescueTestJSONUnderV235-262437214 tempest-ServerRescueTestJSONUnderV235-262437214-project-member] Enqueued Resource ID: 83648dc4-e98f-47b1-b96c-2c0a05ebae74 with Priority: HIGHEST for action security_group_rules [ 728.875520] env[65065]: INFO networking_nsxv3.common.synchronization [req-eb5caf03-30b8-4e35-b83c-21055b693e20 req-3a02143f-b695-4fd6-ba2e-6b88ec098098 tempest-ServerRescueTestJSONUnderV235-262437214 tempest-ServerRescueTestJSONUnderV235-262437214-project-member] Enqueued Resource ID: 83648dc4-e98f-47b1-b96c-2c0a05ebae74 with Priority: HIGHEST for action security_group_members [ 728.875668] env[65065]: INFO networking_nsxv3.common.synchronization [req-eb5caf03-30b8-4e35-b83c-21055b693e20 req-3a02143f-b695-4fd6-ba2e-6b88ec098098 tempest-ServerRescueTestJSONUnderV235-262437214 tempest-ServerRescueTestJSONUnderV235-262437214-project-member] Enqueued Resource ID: ba9173ab-6222-47e3-b895-afd2fa79a40c with Priority: HIGHEST for action port [ 728.876374] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83648dc4-e98f-47b1-b96c-2c0a05ebae74 with Priority: HIGHEST for action security_group_rules [ 728.876576] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83648dc4-e98f-47b1-b96c-2c0a05ebae74 with Priority: HIGHEST for action security_group_members [ 728.876656] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba9173ab-6222-47e3-b895-afd2fa79a40c with Priority: HIGHEST for action port [ 728.876991] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-83648dc4-e98f-47b1-b96c-2c0a05ebae74 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.877150] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-83648dc4-e98f-47b1-b96c-2c0a05ebae74" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.877399] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-83648dc4-e98f-47b1-b96c-2c0a05ebae74 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.877494] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83648dc4-e98f-47b1-b96c-2c0a05ebae74" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.878980] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-ba9173ab-6222-47e3-b895-afd2fa79a40c taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.879161] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ba9173ab-6222-47e3-b895-afd2fa79a40c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.879266] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ba9173ab-6222-47e3-b895-afd2fa79a40c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.879581] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ba9173ab-6222-47e3-b895-afd2fa79a40c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.879727] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ba9173ab-6222-47e3-b895-afd2fa79a40c',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.195439] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-620bfc73-f8be-4924-840f-8cc06371ccef taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.195821] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-620bfc73-f8be-4924-840f-8cc06371ccef" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.195821] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-620bfc73-f8be-4924-840f-8cc06371ccef" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.196268] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-620bfc73-f8be-4924-840f-8cc06371ccef" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.196268] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.196430] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.196430] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.196630] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.196718] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.196810] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-620bfc73-f8be-4924-840f-8cc06371ccef" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.196987] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-620bfc73-f8be-4924-840f-8cc06371ccef taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.197108] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-620bfc73-f8be-4924-840f-8cc06371ccef" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.197166] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-620bfc73-f8be-4924-840f-8cc06371ccef" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.197426] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-620bfc73-f8be-4924-840f-8cc06371ccef" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.197484] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.197571] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.197640] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.197770] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.197852] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.197934] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-620bfc73-f8be-4924-840f-8cc06371ccef" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.198141] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('620bfc73-f8be-4924-840f-8cc06371ccef',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.382686] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ba9173ab-6222-47e3-b895-afd2fa79a40c with status ACTIVE [ 729.383059] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.383159] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.383221] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.383490] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.383615] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.383775] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.383900] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.383954] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.384161] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.384236] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.384438] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.384527] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.384587] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.384763] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.384846] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.384904] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ba9173ab-6222-47e3-b895-afd2fa79a40c is going to be updated. [ 729.423828] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.424072] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.424683] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.424683] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.424683] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.424823] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ba9173ab-6222-47e3-b895-afd2fa79a40c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.566326] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4473193a-198b-4342-a9ef-a1966ddd9441 in Status: SUCCESS [ 729.566326] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4473193a-198b-4342-a9ef-a1966ddd9441" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.702165] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 620bfc73-f8be-4924-840f-8cc06371ccef: rpc.has_security_group_logging(os_id): False [ 729.730902] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.731060] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.731134] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.731353] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.731444] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.731952] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.732083] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.732147] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.732335] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.732422] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.732609] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.733874] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.733874] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.733874] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.733874] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.733874] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.733874] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.733874] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.733874] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.733874] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.733874] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 620bfc73-f8be-4924-840f-8cc06371ccef is going to be created. [ 729.812047] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.812401] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.812528] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.812949] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.813229] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.829379] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 620bfc73-f8be-4924-840f-8cc06371ccef in Status: IN_PROGRESS for 2s [ 730.434025] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1b385f63-63eb-4c26-8064-58a7fa9195f5 in Status: SUCCESS [ 730.434025] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b385f63-63eb-4c26-8064-58a7fa9195f5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.434025] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b385f63-63eb-4c26-8064-58a7fa9195f5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.434025] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b385f63-63eb-4c26-8064-58a7fa9195f5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.434025] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.434025] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.434025] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.434025] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.434025] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.434025] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1b385f63-63eb-4c26-8064-58a7fa9195f5',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.437893] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83648dc4-e98f-47b1-b96c-2c0a05ebae74 in Status: SUCCESS [ 730.437893] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83648dc4-e98f-47b1-b96c-2c0a05ebae74" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.437893] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83648dc4-e98f-47b1-b96c-2c0a05ebae74" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.437893] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83648dc4-e98f-47b1-b96c-2c0a05ebae74" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.438665] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.438993] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.439421] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.439528] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.440016] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.440016] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('83648dc4-e98f-47b1-b96c-2c0a05ebae74',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.937226] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.937442] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.937540] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.937745] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.937916] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.938157] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.940539] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.940539] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.940539] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.940539] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.940539] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1b385f63-63eb-4c26-8064-58a7fa9195f5 is going to be deleted. [ 730.943377] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('83648dc4-e98f-47b1-b96c-2c0a05ebae74',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.985097] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.985097] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.985097] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.985097] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.985097] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.985097] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b385f63-63eb-4c26-8064-58a7fa9195f5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.985440] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b385f63-63eb-4c26-8064-58a7fa9195f5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.985440] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b385f63-63eb-4c26-8064-58a7fa9195f5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.985528] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.985632] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.985693] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.985939] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.986064] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.986101] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1b385f63-63eb-4c26-8064-58a7fa9195f5',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.446311] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('83648dc4-e98f-47b1-b96c-2c0a05ebae74',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.488300] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.488466] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.488544] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.488771] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.488864] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.489210] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.489389] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.489458] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.489636] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.489720] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.489811] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1b385f63-63eb-4c26-8064-58a7fa9195f5 already deleted. [ 731.489892] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b385f63-63eb-4c26-8064-58a7fa9195f5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.490015] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1b385f63-63eb-4c26-8064-58a7fa9195f5',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.491476] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b385f63-63eb-4c26-8064-58a7fa9195f5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.491678] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b385f63-63eb-4c26-8064-58a7fa9195f5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.491836] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.491937] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.491997] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.492175] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.493081] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.493081] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1b385f63-63eb-4c26-8064-58a7fa9195f5',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.843141] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 620bfc73-f8be-4924-840f-8cc06371ccef in Status: SUCCESS [ 731.843537] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-620bfc73-f8be-4924-840f-8cc06371ccef" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.949678] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.949960] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.950151] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.950462] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.950575] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.950680] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 83648dc4-e98f-47b1-b96c-2c0a05ebae74 is going to be updated. [ 731.985103] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.985244] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.985318] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.985606] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.985786] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.994534] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1b385f63-63eb-4c26-8064-58a7fa9195f5',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.995618] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.995736] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.995804] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.996048] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.996142] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.996363] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.996515] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.996515] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.996683] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.996758] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.996840] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1b385f63-63eb-4c26-8064-58a7fa9195f5 already deleted. [ 731.996918] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b385f63-63eb-4c26-8064-58a7fa9195f5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.997773] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83648dc4-e98f-47b1-b96c-2c0a05ebae74 in Status: IN_PROGRESS for 2s [ 732.159558] env[65065]: INFO networking_nsxv3.common.synchronization [req-0bb740de-270b-46b1-83d1-ba3410d2c019 req-e5854fc3-8a83-429c-8a76-c88936534012 tempest-ServerDiskConfigTestJSON-975440465 tempest-ServerDiskConfigTestJSON-975440465-project-member] Enqueued Resource ID: ffd44fac-c762-408c-862b-ccea34e00947 with Priority: HIGHEST for action security_group_members [ 732.160213] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ffd44fac-c762-408c-862b-ccea34e00947 with Priority: HIGHEST for action security_group_members [ 732.160567] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-ffd44fac-c762-408c-862b-ccea34e00947 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.160712] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.160765] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.161076] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.161187] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.161291] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.161353] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.161528] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.162201] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.162201] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ffd44fac-c762-408c-862b-ccea34e00947',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.499624] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1b385f63-63eb-4c26-8064-58a7fa9195f5: rpc.has_security_group_logging(os_id): False [ 732.519962] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.520226] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.520226] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.520429] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.520545] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.520857] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.520981] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.521068] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.521336] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.521416] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.521531] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1b385f63-63eb-4c26-8064-58a7fa9195f5 is going to be created. [ 732.554136] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/1b385f63-63eb-4c26-8064-58a7fa9195f5], does not exist path=[/infra/domains/default/groups/1b385f63-63eb-4c26-8064-58a7fa9195f5]."\n}' [ 732.554375] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1b385f63-63eb-4c26-8064-58a7fa9195f5 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/1b385f63-63eb-4c26-8064-58a7fa9195f5 [ 732.554475] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 732.579337] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock network-34 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.579676] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "network-34" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.579891] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "network-34" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.580289] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "network-34" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.580682] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.580913] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.581143] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.581474] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.581654] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.581880] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 732.581990] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 732.582135] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 732.582327] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 732.582552] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 732.582717] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 732.582910] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 732.613608] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 732.613929] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 732.614181] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 732.614452] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "network-34" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.614952] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock port-7594b10b-1299-41bc-9672-e9bad9533693 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.615266] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "port-7594b10b-1299-41bc-9672-e9bad9533693" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.615479] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "port-7594b10b-1299-41bc-9672-e9bad9533693" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.616083] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "port-7594b10b-1299-41bc-9672-e9bad9533693" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.616350] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7594b10b-1299-41bc-9672-e9bad9533693',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.630335] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.630710] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.630710] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.631035] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.632915] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.633425] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.633616] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.633732] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.634065] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.634205] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.634597] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.634758] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.635607] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.635879] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.636021] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.636191] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1b385f63-63eb-4c26-8064-58a7fa9195f5 is going to be created. [ 732.664675] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/1b385f63-63eb-4c26-8064-58a7fa9195f5], does not exist path=[/infra/domains/default/groups/1b385f63-63eb-4c26-8064-58a7fa9195f5]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/1b385f63-63eb-4c26-8064-58a7fa9195f5 [ 732.664942] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1b385f63-63eb-4c26-8064-58a7fa9195f5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.665695] env[65065]: Traceback (most recent call last): [ 732.665740] env[65065]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 732.665740] env[65065]: return func(*args, **kwargs) [ 732.665740] env[65065]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 732.665740] env[65065]: res.raise_for_status() [ 732.665740] env[65065]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 732.665740] env[65065]: raise HTTPError(http_error_msg, response=self) [ 732.665740] env[65065]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/1b385f63-63eb-4c26-8064-58a7fa9195f5 [ 732.665740] env[65065]: During handling of the above exception, another exception occurred: [ 732.665740] env[65065]: Traceback (most recent call last): [ 732.665996] env[65065]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 732.665996] env[65065]: listener.cb(fileno) [ 732.665996] env[65065]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 732.665996] env[65065]: result = function(*args, **kwargs) [ 732.665996] env[65065]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 732.665996] env[65065]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 732.665996] env[65065]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 732.665996] env[65065]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 732.665996] env[65065]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 732.665996] env[65065]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 732.665996] env[65065]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 732.665996] env[65065]: res.raise_for_status() [ 732.665996] env[65065]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 732.665996] env[65065]: raise HTTPError(http_error_msg, response=self) [ 732.665996] env[65065]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/1b385f63-63eb-4c26-8064-58a7fa9195f5 [ 732.665996] env[65065]: Removing descriptor: 18 [ 732.666414] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.666470] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.666556] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.666839] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.690035] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.690339] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.690463] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.690530] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.690743] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.691261] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.691261] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ffd44fac-c762-408c-862b-ccea34e00947 is going to be updated. [ 732.717266] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.717476] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.717476] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.717589] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.718829] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.731282] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ffd44fac-c762-408c-862b-ccea34e00947 in Status: IN_PROGRESS for 2s [ 733.120717] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.120898] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.120958] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.121283] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.121429] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.121577] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Segment Port 7594b10b-1299-41bc-9672-e9bad9533693 not found, creating... [ 733.121850] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.122026] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.122181] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.122431] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.122548] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.122840] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.123009] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.126336] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.126336] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.126336] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.126336] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Resource: SegmentPort with ID: 7594b10b-1299-41bc-9672-e9bad9533693 is going to be created. [ 733.150112] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.150112] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.150112] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.150112] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.150112] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.150112] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "port-7594b10b-1299-41bc-9672-e9bad9533693" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.873448] env[65065]: INFO networking_nsxv3.common.synchronization [req-0bb740de-270b-46b1-83d1-ba3410d2c019 req-14377f06-6b94-45ff-88fb-96ea295d0c0c service nova] Enqueued Resource ID: ffd44fac-c762-408c-862b-ccea34e00947 with Priority: HIGHEST for action security_group_rules [ 733.873724] env[65065]: INFO networking_nsxv3.common.synchronization [req-0bb740de-270b-46b1-83d1-ba3410d2c019 req-14377f06-6b94-45ff-88fb-96ea295d0c0c service nova] Enqueued Resource ID: ffd44fac-c762-408c-862b-ccea34e00947 with Priority: HIGHEST for action security_group_members [ 733.873956] env[65065]: INFO networking_nsxv3.common.synchronization [req-0bb740de-270b-46b1-83d1-ba3410d2c019 req-14377f06-6b94-45ff-88fb-96ea295d0c0c service nova] Enqueued Resource ID: 7594b10b-1299-41bc-9672-e9bad9533693 with Priority: HIGHEST for action port [ 733.874867] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ffd44fac-c762-408c-862b-ccea34e00947 with Priority: HIGHEST for action security_group_rules [ 733.874994] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ffd44fac-c762-408c-862b-ccea34e00947 with Priority: HIGHEST for action security_group_members [ 733.875176] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7594b10b-1299-41bc-9672-e9bad9533693 with Priority: HIGHEST for action port [ 733.875613] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ffd44fac-c762-408c-862b-ccea34e00947 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.875794] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.875870] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.876307] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.876451] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ffd44fac-c762-408c-862b-ccea34e00947',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.878638] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-ffd44fac-c762-408c-862b-ccea34e00947 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.878761] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.878964] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-7594b10b-1299-41bc-9672-e9bad9533693 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.879136] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7594b10b-1299-41bc-9672-e9bad9533693" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.879136] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7594b10b-1299-41bc-9672-e9bad9533693" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.879337] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7594b10b-1299-41bc-9672-e9bad9533693" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.879418] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7594b10b-1299-41bc-9672-e9bad9533693',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.927398] env[65065]: INFO networking_nsxv3.common.synchronization [None req-da8a6898-462f-4541-9dd1-9fbf2496508f None None] Enqueued Resource ID: 1d6ce62d-e6dc-40bf-9f65-ecc7ddec5a9c with Priority: HIGHEST for action port [ 733.927528] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d6ce62d-e6dc-40bf-9f65-ecc7ddec5a9c with Priority: HIGHEST for action port [ 733.928208] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-1d6ce62d-e6dc-40bf-9f65-ecc7ddec5a9c taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.928378] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1d6ce62d-e6dc-40bf-9f65-ecc7ddec5a9c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.928457] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1d6ce62d-e6dc-40bf-9f65-ecc7ddec5a9c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.932476] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1d6ce62d-e6dc-40bf-9f65-ecc7ddec5a9c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.932636] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1d6ce62d-e6dc-40bf-9f65-ecc7ddec5a9c',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.013957] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83648dc4-e98f-47b1-b96c-2c0a05ebae74 in Status: SUCCESS [ 734.014262] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83648dc4-e98f-47b1-b96c-2c0a05ebae74" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.016031] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83648dc4-e98f-47b1-b96c-2c0a05ebae74" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.016031] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83648dc4-e98f-47b1-b96c-2c0a05ebae74" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.016031] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.016031] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.016031] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.016031] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.016031] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.016031] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83648dc4-e98f-47b1-b96c-2c0a05ebae74" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.016031] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('83648dc4-e98f-47b1-b96c-2c0a05ebae74',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.016650] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83648dc4-e98f-47b1-b96c-2c0a05ebae74" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.017894] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83648dc4-e98f-47b1-b96c-2c0a05ebae74" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.018145] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.018270] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.018337] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.018486] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.018572] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.018668] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('83648dc4-e98f-47b1-b96c-2c0a05ebae74',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.379872] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-ffd44fac-c762-408c-862b-ccea34e00947 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.379872] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.381177] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7594b10b-1299-41bc-9672-e9bad9533693 with status ACTIVE [ 734.381319] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.381443] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.381519] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.381773] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.381854] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.382039] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.382139] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.382201] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.382348] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.382422] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.382604] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.382692] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.383025] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.383025] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.383025] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.383204] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7594b10b-1299-41bc-9672-e9bad9533693 is going to be updated. [ 734.413082] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.413082] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.413082] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.413264] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.413361] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.413520] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7594b10b-1299-41bc-9672-e9bad9533693" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.440030] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1d6ce62d-e6dc-40bf-9f65-ecc7ddec5a9c [ 734.440363] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.440541] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.440670] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.440895] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.441027] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.441149] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1d6ce62d-e6dc-40bf-9f65-ecc7ddec5a9c already deleted. [ 734.441283] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1d6ce62d-e6dc-40bf-9f65-ecc7ddec5a9c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.522652] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-83648dc4-e98f-47b1-b96c-2c0a05ebae74 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.522652] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83648dc4-e98f-47b1-b96c-2c0a05ebae74" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.522652] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('83648dc4-e98f-47b1-b96c-2c0a05ebae74',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.742441] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ffd44fac-c762-408c-862b-ccea34e00947 in Status: SUCCESS [ 734.742581] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ffd44fac-c762-408c-862b-ccea34e00947 deletion is rescheduled due to dependency. [ 734.742695] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.742878] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.743112] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.743300] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.743499] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.743561] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.743742] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.743792] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.743874] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ffd44fac-c762-408c-862b-ccea34e00947',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.027347] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('83648dc4-e98f-47b1-b96c-2c0a05ebae74',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.247303] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ffd44fac-c762-408c-862b-ccea34e00947',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.530473] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.530473] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.530473] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.530473] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.531191] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.531191] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 83648dc4-e98f-47b1-b96c-2c0a05ebae74 is going to be updated. [ 735.562342] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.562508] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.562548] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.563550] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.563550] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.575894] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83648dc4-e98f-47b1-b96c-2c0a05ebae74 in Status: IN_PROGRESS for 2s [ 735.749115] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ffd44fac-c762-408c-862b-ccea34e00947',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.254360] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.254360] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.254360] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.254360] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.254360] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.254360] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ffd44fac-c762-408c-862b-ccea34e00947 is going to be updated. [ 736.294273] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.294399] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.294448] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.295031] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.295031] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.306528] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ffd44fac-c762-408c-862b-ccea34e00947 in Status: IN_PROGRESS for 2s [ 736.315041] env[65065]: INFO networking_nsxv3.common.synchronization [None req-24886841-a34e-4c41-9b91-79b6851e233c None None] Enqueued Resource ID: 60e1c8d9-1094-4a91-b281-009ee5047ba4 with Priority: HIGHEST for action port [ 736.315710] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60e1c8d9-1094-4a91-b281-009ee5047ba4 with Priority: HIGHEST for action port [ 736.316258] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-60e1c8d9-1094-4a91-b281-009ee5047ba4 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.316556] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-60e1c8d9-1094-4a91-b281-009ee5047ba4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.316556] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-60e1c8d9-1094-4a91-b281-009ee5047ba4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.317372] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-60e1c8d9-1094-4a91-b281-009ee5047ba4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.317372] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('60e1c8d9-1094-4a91-b281-009ee5047ba4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.819661] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 60e1c8d9-1094-4a91-b281-009ee5047ba4 [ 736.819975] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.821240] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.821240] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.821240] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.821240] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.821240] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:60e1c8d9-1094-4a91-b281-009ee5047ba4 already deleted. [ 736.821240] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-60e1c8d9-1094-4a91-b281-009ee5047ba4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.589327] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83648dc4-e98f-47b1-b96c-2c0a05ebae74 in Status: SUCCESS [ 737.589327] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83648dc4-e98f-47b1-b96c-2c0a05ebae74" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.589327] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83648dc4-e98f-47b1-b96c-2c0a05ebae74" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.589781] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83648dc4-e98f-47b1-b96c-2c0a05ebae74" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.589862] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.590920] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.590920] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.590920] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.590920] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.590920] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('83648dc4-e98f-47b1-b96c-2c0a05ebae74',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.093367] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('83648dc4-e98f-47b1-b96c-2c0a05ebae74',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.323748] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ffd44fac-c762-408c-862b-ccea34e00947 in Status: SUCCESS [ 738.323980] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.325745] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.325745] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.325745] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.325745] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.325745] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.325745] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.325745] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.325745] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.325745] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ffd44fac-c762-408c-862b-ccea34e00947',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.496240] env[65065]: INFO networking_nsxv3.common.synchronization [req-95633f37-faaf-4d96-9ef4-67f7aface7da req-5fe0890a-844d-48d2-b14d-29d05ad89043 tempest-ImagesOneServerNegativeTestJSON-764093247 tempest-ImagesOneServerNegativeTestJSON-764093247-project-member] Enqueued Resource ID: 9ed22036-e9a4-4639-89b9-c743ca686b09 with Priority: HIGHEST for action security_group_members [ 738.496728] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ed22036-e9a4-4639-89b9-c743ca686b09 with Priority: HIGHEST for action security_group_members [ 738.497032] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ed22036-e9a4-4639-89b9-c743ca686b09 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.497160] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ed22036-e9a4-4639-89b9-c743ca686b09" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.497224] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ed22036-e9a4-4639-89b9-c743ca686b09" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.497424] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ed22036-e9a4-4639-89b9-c743ca686b09" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.497569] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.497665] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.497726] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.497855] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.498714] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.498837] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ed22036-e9a4-4639-89b9-c743ca686b09',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.595743] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('83648dc4-e98f-47b1-b96c-2c0a05ebae74',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.828201] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-ffd44fac-c762-408c-862b-ccea34e00947 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.828376] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.828449] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.828692] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.828887] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.828992] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.829079] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.829302] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.829401] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.829498] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.829654] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-ffd44fac-c762-408c-862b-ccea34e00947 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.829751] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.829812] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.829967] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.830135] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.830233] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.830297] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.830626] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.830713] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.830814] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.830912] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ffd44fac-c762-408c-862b-ccea34e00947',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.847364] env[65065]: INFO networking_nsxv3.common.synchronization [req-46efa304-8d37-46f0-84b9-aa4a0b78e3ce req-f8721f32-360d-4b29-a2af-c4b95f41a98f tempest-ImagesNegativeTestJSON-279276685 tempest-ImagesNegativeTestJSON-279276685-project-member] Enqueued Resource ID: 620bfc73-f8be-4924-840f-8cc06371ccef with Priority: HIGHEST for action security_group_members [ 738.847894] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 620bfc73-f8be-4924-840f-8cc06371ccef with Priority: HIGHEST for action security_group_members [ 738.848254] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-620bfc73-f8be-4924-840f-8cc06371ccef taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.848399] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-620bfc73-f8be-4924-840f-8cc06371ccef" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.848467] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-620bfc73-f8be-4924-840f-8cc06371ccef" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.848670] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-620bfc73-f8be-4924-840f-8cc06371ccef" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.849449] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.849573] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.849623] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.849806] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.849923] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.850030] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('620bfc73-f8be-4924-840f-8cc06371ccef',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.001372] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.001668] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.001668] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.001873] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.026880] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.027230] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.027338] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.027392] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.027593] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.027679] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.027766] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ed22036-e9a4-4639-89b9-c743ca686b09 is going to be updated. [ 739.070014] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.070213] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.070307] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.070594] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.070772] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.083157] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ed22036-e9a4-4639-89b9-c743ca686b09 in Status: IN_PROGRESS for 2s [ 739.099378] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.099378] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.099378] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.099378] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.099378] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.099378] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 83648dc4-e98f-47b1-b96c-2c0a05ebae74 is going to be updated. [ 739.134631] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.134802] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.134844] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.135081] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.135250] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.146141] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83648dc4-e98f-47b1-b96c-2c0a05ebae74 in Status: IN_PROGRESS for 2s [ 739.263189] env[65065]: INFO networking_nsxv3.common.synchronization [req-a60456c7-ade2-4da0-b58b-8a673ea75d32 req-30c8a3d0-828f-4436-9a53-059ff9958d72 tempest-FloatingIPsAssociationTestJSON-1239844979 tempest-FloatingIPsAssociationTestJSON-1239844979-project-member] Enqueued Resource ID: a7006bfc-4bfa-49da-a51e-6cc26b8098c3 with Priority: HIGHEST for action security_group_members [ 739.263189] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7006bfc-4bfa-49da-a51e-6cc26b8098c3 with Priority: HIGHEST for action security_group_members [ 739.263189] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7006bfc-4bfa-49da-a51e-6cc26b8098c3 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.263189] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7006bfc-4bfa-49da-a51e-6cc26b8098c3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.263189] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7006bfc-4bfa-49da-a51e-6cc26b8098c3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.263974] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7006bfc-4bfa-49da-a51e-6cc26b8098c3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.264379] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.265145] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.265355] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.265652] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.265867] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.266088] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a7006bfc-4bfa-49da-a51e-6cc26b8098c3',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.333924] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ffd44fac-c762-408c-862b-ccea34e00947: rpc.has_security_group_logging(os_id): False [ 739.356157] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.356409] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.356527] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.357402] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.357637] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.357819] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.359060] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.359060] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.359060] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.359060] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.359060] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.359060] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.359060] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.359060] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.360574] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.361024] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.361024] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.361024] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.361024] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.361295] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.361449] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ffd44fac-c762-408c-862b-ccea34e00947 is going to be updated. [ 739.362848] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.362989] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.363083] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.363527] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.385189] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.385622] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.386434] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.386434] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.386434] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.386434] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.386573] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 620bfc73-f8be-4924-840f-8cc06371ccef is going to be updated. [ 739.414213] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.414356] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.414424] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.414632] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.414768] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.425919] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 620bfc73-f8be-4924-840f-8cc06371ccef in Status: IN_PROGRESS for 2s [ 739.437649] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.437649] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.437649] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.437986] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.437986] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.453586] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ffd44fac-c762-408c-862b-ccea34e00947 in Status: IN_PROGRESS for 2s [ 739.701176] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock network-80 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.701918] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "network-80" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.702649] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "network-80" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.703095] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "network-80" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.703545] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.703846] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.706301] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.706301] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.706301] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.706301] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 739.706301] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 739.706301] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 739.706301] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 739.706301] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 739.706301] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 739.706301] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 739.726855] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 739.727139] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 739.727284] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 739.727452] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "network-80" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.727760] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock port-381ed789-4fea-491c-be1c-0dbedf436ac6 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.727935] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "port-381ed789-4fea-491c-be1c-0dbedf436ac6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.728056] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "port-381ed789-4fea-491c-be1c-0dbedf436ac6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.728426] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "port-381ed789-4fea-491c-be1c-0dbedf436ac6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.728559] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('381ed789-4fea-491c-be1c-0dbedf436ac6',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.770084] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.770246] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.770320] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.770539] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.770627] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.770820] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.770920] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.770973] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.771153] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.771205] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.771283] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a7006bfc-4bfa-49da-a51e-6cc26b8098c3 already deleted. [ 739.771360] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7006bfc-4bfa-49da-a51e-6cc26b8098c3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.231625] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.231860] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.231982] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.232275] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.232416] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.232560] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Segment Port 381ed789-4fea-491c-be1c-0dbedf436ac6 not found, creating... [ 740.232810] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.232959] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.233106] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.234158] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.234158] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.234158] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.234158] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.234158] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.236136] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.236136] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.236136] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Resource: SegmentPort with ID: 381ed789-4fea-491c-be1c-0dbedf436ac6 is going to be created. [ 740.257025] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.257025] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.257025] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.257025] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.257279] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.257385] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "port-381ed789-4fea-491c-be1c-0dbedf436ac6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.982331] env[65065]: INFO networking_nsxv3.common.synchronization [req-a60456c7-ade2-4da0-b58b-8a673ea75d32 req-c8a66757-5c49-4c0e-ab83-49de164f4ae2 service nova] Enqueued Resource ID: a7006bfc-4bfa-49da-a51e-6cc26b8098c3 with Priority: HIGHEST for action security_group_rules [ 740.983656] env[65065]: INFO networking_nsxv3.common.synchronization [req-a60456c7-ade2-4da0-b58b-8a673ea75d32 req-c8a66757-5c49-4c0e-ab83-49de164f4ae2 service nova] Enqueued Resource ID: a7006bfc-4bfa-49da-a51e-6cc26b8098c3 with Priority: HIGHEST for action security_group_members [ 740.983656] env[65065]: INFO networking_nsxv3.common.synchronization [req-a60456c7-ade2-4da0-b58b-8a673ea75d32 req-c8a66757-5c49-4c0e-ab83-49de164f4ae2 service nova] Enqueued Resource ID: 381ed789-4fea-491c-be1c-0dbedf436ac6 with Priority: HIGHEST for action port [ 740.984427] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7006bfc-4bfa-49da-a51e-6cc26b8098c3 with Priority: HIGHEST for action security_group_rules [ 740.984711] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7006bfc-4bfa-49da-a51e-6cc26b8098c3 with Priority: HIGHEST for action security_group_members [ 740.985042] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 381ed789-4fea-491c-be1c-0dbedf436ac6 with Priority: HIGHEST for action port [ 740.988019] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a7006bfc-4bfa-49da-a51e-6cc26b8098c3 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.988019] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a7006bfc-4bfa-49da-a51e-6cc26b8098c3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.988019] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a7006bfc-4bfa-49da-a51e-6cc26b8098c3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.988019] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a7006bfc-4bfa-49da-a51e-6cc26b8098c3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.988019] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a7006bfc-4bfa-49da-a51e-6cc26b8098c3',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.988019] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7006bfc-4bfa-49da-a51e-6cc26b8098c3 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.988019] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7006bfc-4bfa-49da-a51e-6cc26b8098c3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.988019] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7006bfc-4bfa-49da-a51e-6cc26b8098c3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.988019] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7006bfc-4bfa-49da-a51e-6cc26b8098c3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.988019] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.988598] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.988782] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.989078] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.989347] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.989600] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a7006bfc-4bfa-49da-a51e-6cc26b8098c3',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.990696] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-381ed789-4fea-491c-be1c-0dbedf436ac6 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.991194] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-381ed789-4fea-491c-be1c-0dbedf436ac6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.992344] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-381ed789-4fea-491c-be1c-0dbedf436ac6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.994097] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-381ed789-4fea-491c-be1c-0dbedf436ac6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.994097] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('381ed789-4fea-491c-be1c-0dbedf436ac6',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.096208] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ed22036-e9a4-4639-89b9-c743ca686b09 in Status: SUCCESS [ 741.096208] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ed22036-e9a4-4639-89b9-c743ca686b09 deletion is rescheduled due to dependency. [ 741.096208] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ed22036-e9a4-4639-89b9-c743ca686b09" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.157166] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83648dc4-e98f-47b1-b96c-2c0a05ebae74 in Status: SUCCESS [ 741.157520] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83648dc4-e98f-47b1-b96c-2c0a05ebae74" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.157771] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83648dc4-e98f-47b1-b96c-2c0a05ebae74" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.158488] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83648dc4-e98f-47b1-b96c-2c0a05ebae74" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.158789] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.159244] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.159365] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.159665] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.159809] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.159965] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83648dc4-e98f-47b1-b96c-2c0a05ebae74" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.160265] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-83648dc4-e98f-47b1-b96c-2c0a05ebae74 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.160472] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83648dc4-e98f-47b1-b96c-2c0a05ebae74" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.160548] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83648dc4-e98f-47b1-b96c-2c0a05ebae74" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.160980] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83648dc4-e98f-47b1-b96c-2c0a05ebae74" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.161247] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.161416] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.161521] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.161790] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.161922] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.162085] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83648dc4-e98f-47b1-b96c-2c0a05ebae74" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.162286] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('83648dc4-e98f-47b1-b96c-2c0a05ebae74',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.437019] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 620bfc73-f8be-4924-840f-8cc06371ccef in Status: SUCCESS [ 741.437423] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 620bfc73-f8be-4924-840f-8cc06371ccef deletion is rescheduled due to dependency. [ 741.437509] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-620bfc73-f8be-4924-840f-8cc06371ccef" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.468711] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ffd44fac-c762-408c-862b-ccea34e00947 in Status: SUCCESS [ 741.469065] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.494636] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a7006bfc-4bfa-49da-a51e-6cc26b8098c3',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.497025] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7006bfc-4bfa-49da-a51e-6cc26b8098c3 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.497025] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7006bfc-4bfa-49da-a51e-6cc26b8098c3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.498432] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 381ed789-4fea-491c-be1c-0dbedf436ac6 with status ACTIVE [ 741.498720] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.498893] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.499802] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.499802] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.499802] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.500591] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.500745] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.500856] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.500968] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.501086] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.501538] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.501538] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.501538] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.501838] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.501838] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.501838] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 381ed789-4fea-491c-be1c-0dbedf436ac6 is going to be updated. [ 741.525543] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.525543] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.525543] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.525543] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.525782] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.525892] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-381ed789-4fea-491c-be1c-0dbedf436ac6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.664795] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 83648dc4-e98f-47b1-b96c-2c0a05ebae74: rpc.has_security_group_logging(os_id): False [ 741.689261] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.689451] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.689451] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.690580] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.727216] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.727370] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.727826] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.727826] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.728867] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.728867] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.728867] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.728867] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.728867] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.728867] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.728867] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.729670] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.730667] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.730667] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.730667] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.730667] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.730667] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 83648dc4-e98f-47b1-b96c-2c0a05ebae74 is going to be updated. [ 741.892122] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.892282] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.892282] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.892877] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.892877] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.911617] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 83648dc4-e98f-47b1-b96c-2c0a05ebae74 in Status: IN_PROGRESS for 2s [ 741.997864] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a7006bfc-4bfa-49da-a51e-6cc26b8098c3',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.024515] env[65065]: INFO networking_nsxv3.common.synchronization [None req-f708bbd7-4824-492e-bf7f-a3c86bbd7996 None None] Enqueued Resource ID: 91b359be-a875-47e0-8a63-7d330083eefc with Priority: HIGHEST for action port [ 742.025127] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 91b359be-a875-47e0-8a63-7d330083eefc with Priority: HIGHEST for action port [ 742.025521] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-91b359be-a875-47e0-8a63-7d330083eefc taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.025627] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-91b359be-a875-47e0-8a63-7d330083eefc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.025676] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-91b359be-a875-47e0-8a63-7d330083eefc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.025930] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-91b359be-a875-47e0-8a63-7d330083eefc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.027555] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('91b359be-a875-47e0-8a63-7d330083eefc',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.502576] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.502805] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.502965] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.503184] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.503324] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.503443] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a7006bfc-4bfa-49da-a51e-6cc26b8098c3 is going to be created. [ 742.529739] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 91b359be-a875-47e0-8a63-7d330083eefc [ 742.530050] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.531170] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.531170] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.531170] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.531170] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.531170] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:91b359be-a875-47e0-8a63-7d330083eefc already deleted. [ 742.531170] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-91b359be-a875-47e0-8a63-7d330083eefc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.536356] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.537316] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.537316] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.537316] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.537316] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.550405] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7006bfc-4bfa-49da-a51e-6cc26b8098c3 in Status: UNINITIALIZED for 2s [ 742.954129] env[65065]: INFO networking_nsxv3.common.synchronization [req-150797ed-29b6-4b26-8319-fb412b7eb275 req-677c02a8-cea9-4f9e-98e9-c018dc0401fc tempest-ServerAddressesTestJSON-290914398 tempest-ServerAddressesTestJSON-290914398-project-member] Enqueued Resource ID: 4473193a-198b-4342-a9ef-a1966ddd9441 with Priority: HIGHEST for action security_group_members [ 742.955679] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4473193a-198b-4342-a9ef-a1966ddd9441 with Priority: HIGHEST for action security_group_members [ 742.956261] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-4473193a-198b-4342-a9ef-a1966ddd9441 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.957777] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4473193a-198b-4342-a9ef-a1966ddd9441" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.957868] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4473193a-198b-4342-a9ef-a1966ddd9441" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.958107] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4473193a-198b-4342-a9ef-a1966ddd9441" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.958332] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.958452] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.958520] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.958718] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.958827] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.958929] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4473193a-198b-4342-a9ef-a1966ddd9441',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.436645] env[65065]: INFO networking_nsxv3.common.synchronization [None req-79f1e4b0-b881-47ab-888c-5411a75004b9 tempest-ServersTestManualDisk-1006050063 tempest-ServersTestManualDisk-1006050063-project-member] Enqueued Resource ID: f9002bdd-0416-4909-9ac7-2b8cecd66558 with Priority: HIGHEST for action security_group_rules [ 743.438179] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9002bdd-0416-4909-9ac7-2b8cecd66558 with Priority: HIGHEST for action security_group_rules [ 743.439537] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f9002bdd-0416-4909-9ac7-2b8cecd66558 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.439684] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f9002bdd-0416-4909-9ac7-2b8cecd66558" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.439987] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f9002bdd-0416-4909-9ac7-2b8cecd66558" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.440418] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f9002bdd-0416-4909-9ac7-2b8cecd66558" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.440418] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f9002bdd-0416-4909-9ac7-2b8cecd66558',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.462265] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.462400] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.462477] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.463651] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.487023] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.487023] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.487023] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.487023] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.487023] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.487023] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.487023] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4473193a-198b-4342-a9ef-a1966ddd9441 is going to be updated. [ 743.516326] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.517022] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.517022] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.517022] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.517022] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.526699] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4473193a-198b-4342-a9ef-a1966ddd9441 in Status: IN_PROGRESS for 2s [ 743.593670] env[65065]: INFO networking_nsxv3.common.synchronization [None req-69eca3bf-6ae3-4976-83a7-e68055bb11b6 tempest-ServersTestManualDisk-1006050063 tempest-ServersTestManualDisk-1006050063-project-member] Enqueued Resource ID: f9002bdd-0416-4909-9ac7-2b8cecd66558 with Priority: HIGHEST for action security_group_rules [ 743.593855] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9002bdd-0416-4909-9ac7-2b8cecd66558 with Priority: HIGHEST for action security_group_rules [ 743.594186] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f9002bdd-0416-4909-9ac7-2b8cecd66558 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.594294] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f9002bdd-0416-4909-9ac7-2b8cecd66558" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.928203] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 83648dc4-e98f-47b1-b96c-2c0a05ebae74 in Status: SUCCESS [ 743.928465] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-83648dc4-e98f-47b1-b96c-2c0a05ebae74" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.928671] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-83648dc4-e98f-47b1-b96c-2c0a05ebae74" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.928897] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-83648dc4-e98f-47b1-b96c-2c0a05ebae74" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.930133] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('83648dc4-e98f-47b1-b96c-2c0a05ebae74',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.961716] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.961907] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.961970] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.963192] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.963192] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.963192] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f9002bdd-0416-4909-9ac7-2b8cecd66558 already deleted. [ 743.963192] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f9002bdd-0416-4909-9ac7-2b8cecd66558" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.963192] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f9002bdd-0416-4909-9ac7-2b8cecd66558" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.963192] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f9002bdd-0416-4909-9ac7-2b8cecd66558" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.963192] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f9002bdd-0416-4909-9ac7-2b8cecd66558',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.432221] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-83648dc4-e98f-47b1-b96c-2c0a05ebae74 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.432221] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83648dc4-e98f-47b1-b96c-2c0a05ebae74" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.432426] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83648dc4-e98f-47b1-b96c-2c0a05ebae74" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.432630] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83648dc4-e98f-47b1-b96c-2c0a05ebae74" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.433031] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.433131] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.434076] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.434076] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.434076] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.434076] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83648dc4-e98f-47b1-b96c-2c0a05ebae74" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.434076] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('83648dc4-e98f-47b1-b96c-2c0a05ebae74',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.495246] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.495246] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.495246] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.495809] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.495809] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.495809] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f9002bdd-0416-4909-9ac7-2b8cecd66558 already deleted. [ 744.495958] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f9002bdd-0416-4909-9ac7-2b8cecd66558" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.540732] env[65065]: INFO networking_nsxv3.common.synchronization [req-f2b884b5-eb05-43f7-ab34-0ca69d71fd0a req-f2f6d209-d31c-4b99-9497-e44b0b434fce tempest-MigrationsAdminTest-1843927703 tempest-MigrationsAdminTest-1843927703-project-member] Enqueued Resource ID: 45ff18a7-4a73-49de-af36-6c1d70b047f6 with Priority: HIGHEST for action security_group_members [ 744.541356] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45ff18a7-4a73-49de-af36-6c1d70b047f6 with Priority: HIGHEST for action security_group_members [ 744.541746] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-45ff18a7-4a73-49de-af36-6c1d70b047f6 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.541881] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45ff18a7-4a73-49de-af36-6c1d70b047f6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.542007] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45ff18a7-4a73-49de-af36-6c1d70b047f6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.542242] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45ff18a7-4a73-49de-af36-6c1d70b047f6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.542398] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.542511] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.542603] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.542765] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.542865] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.542996] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('45ff18a7-4a73-49de-af36-6c1d70b047f6',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.564264] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7006bfc-4bfa-49da-a51e-6cc26b8098c3 in Status: SUCCESS [ 744.564264] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7006bfc-4bfa-49da-a51e-6cc26b8098c3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.564264] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7006bfc-4bfa-49da-a51e-6cc26b8098c3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.564264] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7006bfc-4bfa-49da-a51e-6cc26b8098c3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.564264] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.564264] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.564264] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.564665] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.564729] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.564877] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7006bfc-4bfa-49da-a51e-6cc26b8098c3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.564984] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a7006bfc-4bfa-49da-a51e-6cc26b8098c3',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.857861] env[65065]: INFO networking_nsxv3.common.synchronization [None req-e6db0a5d-6658-49cf-81a4-639006990dd9 None None] Enqueued Resource ID: 4bb6f14d-24fc-412b-91a7-16fd269af7b8 with Priority: HIGHEST for action port [ 744.859613] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4bb6f14d-24fc-412b-91a7-16fd269af7b8 with Priority: HIGHEST for action port [ 744.862171] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-4bb6f14d-24fc-412b-91a7-16fd269af7b8 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.862171] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4bb6f14d-24fc-412b-91a7-16fd269af7b8" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.862171] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4bb6f14d-24fc-412b-91a7-16fd269af7b8" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.862171] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4bb6f14d-24fc-412b-91a7-16fd269af7b8" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.862171] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4bb6f14d-24fc-412b-91a7-16fd269af7b8',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.939711] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-83648dc4-e98f-47b1-b96c-2c0a05ebae74 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.939711] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83648dc4-e98f-47b1-b96c-2c0a05ebae74" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.939938] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83648dc4-e98f-47b1-b96c-2c0a05ebae74" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.942150] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83648dc4-e98f-47b1-b96c-2c0a05ebae74" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.943501] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.943501] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.943501] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.943501] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.943501] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.943501] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83648dc4-e98f-47b1-b96c-2c0a05ebae74" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.943501] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-83648dc4-e98f-47b1-b96c-2c0a05ebae74 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.943501] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83648dc4-e98f-47b1-b96c-2c0a05ebae74" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.943501] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83648dc4-e98f-47b1-b96c-2c0a05ebae74" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.943981] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83648dc4-e98f-47b1-b96c-2c0a05ebae74" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.943981] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.944091] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.948025] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.948025] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.948025] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.948025] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83648dc4-e98f-47b1-b96c-2c0a05ebae74" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.948025] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('83648dc4-e98f-47b1-b96c-2c0a05ebae74',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.016757] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock network-11 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.017702] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "network-11" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.017702] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "network-11" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.017861] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "network-11" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.018326] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.018814] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.018814] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.019128] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.019323] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.019558] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 745.019705] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 745.019849] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 745.019918] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 745.020037] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 745.020142] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 745.020282] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 745.046653] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('45ff18a7-4a73-49de-af36-6c1d70b047f6',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.053019] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 745.053629] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Cache value generated in 0.033 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 745.053629] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 745.053629] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "network-11" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.053822] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock port-38e61e10-04a7-4fca-ae7b-ad24c1de0978 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.054031] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "port-38e61e10-04a7-4fca-ae7b-ad24c1de0978" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.054121] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "port-38e61e10-04a7-4fca-ae7b-ad24c1de0978" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.054842] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "port-38e61e10-04a7-4fca-ae7b-ad24c1de0978" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.054842] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('38e61e10-04a7-4fca-ae7b-ad24c1de0978',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.067589] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7006bfc-4bfa-49da-a51e-6cc26b8098c3 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.068202] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7006bfc-4bfa-49da-a51e-6cc26b8098c3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.068202] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7006bfc-4bfa-49da-a51e-6cc26b8098c3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.068202] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7006bfc-4bfa-49da-a51e-6cc26b8098c3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.068464] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.068576] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.068616] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.068798] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.068881] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.069152] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7006bfc-4bfa-49da-a51e-6cc26b8098c3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.069152] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7006bfc-4bfa-49da-a51e-6cc26b8098c3 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.069289] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7006bfc-4bfa-49da-a51e-6cc26b8098c3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.069346] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7006bfc-4bfa-49da-a51e-6cc26b8098c3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.069514] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7006bfc-4bfa-49da-a51e-6cc26b8098c3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.069726] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.069726] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.069855] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.069951] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.070283] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.070408] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7006bfc-4bfa-49da-a51e-6cc26b8098c3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.070505] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a7006bfc-4bfa-49da-a51e-6cc26b8098c3',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.307237] env[65065]: INFO networking_nsxv3.common.synchronization [req-638b1dbd-cd73-416d-92a9-dc896f800df8 req-ec13eb23-3e06-44cc-a267-46d5701b06e4 tempest-ImagesTestJSON-1714479415 tempest-ImagesTestJSON-1714479415-project-member] Enqueued Resource ID: e6d7baac-4bff-46b9-b88d-2dc982621c0f with Priority: HIGHEST for action security_group_members [ 745.307237] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6d7baac-4bff-46b9-b88d-2dc982621c0f with Priority: HIGHEST for action security_group_members [ 745.307237] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6d7baac-4bff-46b9-b88d-2dc982621c0f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.307237] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.307237] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.307866] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.308262] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.308554] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.308764] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.309064] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.310483] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.310483] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e6d7baac-4bff-46b9-b88d-2dc982621c0f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.367110] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4bb6f14d-24fc-412b-91a7-16fd269af7b8 [ 745.367392] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.367540] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.367626] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.367874] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.367975] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.368097] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4bb6f14d-24fc-412b-91a7-16fd269af7b8 already deleted. [ 745.368270] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4bb6f14d-24fc-412b-91a7-16fd269af7b8" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.454576] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 83648dc4-e98f-47b1-b96c-2c0a05ebae74: rpc.has_security_group_logging(os_id): False [ 745.476770] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.476770] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.476770] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.476973] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.476973] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.477302] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.477302] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.477302] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.477465] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.477501] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.477670] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.477784] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.477849] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.477984] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.478289] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.478372] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.478456] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.478542] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.478667] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.478765] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.478825] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 83648dc4-e98f-47b1-b96c-2c0a05ebae74 is going to be updated. [ 745.536295] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4473193a-198b-4342-a9ef-a1966ddd9441 in Status: SUCCESS [ 745.536597] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4473193a-198b-4342-a9ef-a1966ddd9441 deletion is rescheduled due to dependency. [ 745.536597] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4473193a-198b-4342-a9ef-a1966ddd9441" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.545461] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.545645] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.545717] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.546016] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.546164] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.548881] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('45ff18a7-4a73-49de-af36-6c1d70b047f6',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.557006] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.557235] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.557384] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.557621] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.557760] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.557902] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Segment Port 38e61e10-04a7-4fca-ae7b-ad24c1de0978 not found, creating... [ 745.558219] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.558731] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.558731] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.558871] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.558901] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.559304] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.559458] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.559562] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.559762] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.559890] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.560374] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Resource: SegmentPort with ID: 38e61e10-04a7-4fca-ae7b-ad24c1de0978 is going to be created. [ 745.563298] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 83648dc4-e98f-47b1-b96c-2c0a05ebae74 in Status: IN_PROGRESS for 2s [ 745.570826] env[65065]: INFO networking_nsxv3.common.synchronization [req-90359be9-86d7-4ec2-a572-630ce831bb37 req-aa747701-e8a9-4563-a3ba-a90cbe4af0e5 tempest-ServersAdminNegativeTestJSON-568589506 tempest-ServersAdminNegativeTestJSON-568589506-project-member] Enqueued Resource ID: cc04914d-716e-49e1-8a77-946f904f69bb with Priority: HIGHEST for action security_group_members [ 745.571508] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc04914d-716e-49e1-8a77-946f904f69bb with Priority: HIGHEST for action security_group_members [ 745.571805] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc04914d-716e-49e1-8a77-946f904f69bb taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.571922] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc04914d-716e-49e1-8a77-946f904f69bb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.571991] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc04914d-716e-49e1-8a77-946f904f69bb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.572316] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc04914d-716e-49e1-8a77-946f904f69bb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.572499] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.572607] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.572664] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.572810] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.572896] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.572989] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc04914d-716e-49e1-8a77-946f904f69bb',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.574646] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a7006bfc-4bfa-49da-a51e-6cc26b8098c3: rpc.has_security_group_logging(os_id): False [ 745.584449] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.584720] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.585101] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.585272] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.585331] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.585581] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "port-38e61e10-04a7-4fca-ae7b-ad24c1de0978" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.595575] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.595575] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.595575] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.595575] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.595575] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.595872] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.596053] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.596421] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.596421] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.596530] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.596652] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.596774] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.596837] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.596983] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.597187] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.597469] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.597625] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.597772] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.597939] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.598045] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.598162] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a7006bfc-4bfa-49da-a51e-6cc26b8098c3 is going to be created. [ 745.677943] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.678260] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.678448] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.678725] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.679030] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.695118] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a7006bfc-4bfa-49da-a51e-6cc26b8098c3 in Status: IN_PROGRESS for 2s [ 745.812467] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.812707] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.812823] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.813179] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.835846] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.836269] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.836427] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.836514] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.836744] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.836814] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.836908] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6d7baac-4bff-46b9-b88d-2dc982621c0f is going to be updated. [ 745.876716] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.876716] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.876994] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.876994] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.877268] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.887165] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6d7baac-4bff-46b9-b88d-2dc982621c0f in Status: IN_PROGRESS for 2s [ 745.933206] env[65065]: INFO networking_nsxv3.common.synchronization [req-69cb2aac-cdbe-4009-bf18-bb88ce2e66bb req-9ae142ba-30c1-4eb7-92bc-083dc7c5effd tempest-ServerRescueTestJSONUnderV235-262437214 tempest-ServerRescueTestJSONUnderV235-262437214-project-member] Enqueued Resource ID: 83648dc4-e98f-47b1-b96c-2c0a05ebae74 with Priority: HIGHEST for action security_group_members [ 745.933278] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83648dc4-e98f-47b1-b96c-2c0a05ebae74 with Priority: HIGHEST for action security_group_members [ 745.933591] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-83648dc4-e98f-47b1-b96c-2c0a05ebae74 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.933710] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83648dc4-e98f-47b1-b96c-2c0a05ebae74" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.933774] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83648dc4-e98f-47b1-b96c-2c0a05ebae74" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.933986] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83648dc4-e98f-47b1-b96c-2c0a05ebae74" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.934156] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.934250] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.934309] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.934453] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.934533] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.934623] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('83648dc4-e98f-47b1-b96c-2c0a05ebae74',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.050980] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.051154] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.051210] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.051463] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.051557] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.051790] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45ff18a7-4a73-49de-af36-6c1d70b047f6 is going to be updated. [ 746.075448] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.075616] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.075691] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.075917] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.093353] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.093824] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.093824] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.093824] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.093988] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.104468] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45ff18a7-4a73-49de-af36-6c1d70b047f6 in Status: IN_PROGRESS for 2s [ 746.128995] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.129268] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.129552] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.129552] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.129824] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.129944] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.130093] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc04914d-716e-49e1-8a77-946f904f69bb is going to be updated. [ 746.167682] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.167896] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.168027] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.168393] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.168721] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.184140] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc04914d-716e-49e1-8a77-946f904f69bb in Status: IN_PROGRESS for 2s [ 746.341082] env[65065]: INFO networking_nsxv3.common.synchronization [req-f2b884b5-eb05-43f7-ab34-0ca69d71fd0a req-c09b123d-d040-409f-8705-b8c568809211 service nova] Enqueued Resource ID: 45ff18a7-4a73-49de-af36-6c1d70b047f6 with Priority: HIGHEST for action security_group_rules [ 746.341287] env[65065]: INFO networking_nsxv3.common.synchronization [req-f2b884b5-eb05-43f7-ab34-0ca69d71fd0a req-c09b123d-d040-409f-8705-b8c568809211 service nova] Enqueued Resource ID: 45ff18a7-4a73-49de-af36-6c1d70b047f6 with Priority: HIGHEST for action security_group_members [ 746.341418] env[65065]: INFO networking_nsxv3.common.synchronization [req-f2b884b5-eb05-43f7-ab34-0ca69d71fd0a req-c09b123d-d040-409f-8705-b8c568809211 service nova] Enqueued Resource ID: 38e61e10-04a7-4fca-ae7b-ad24c1de0978 with Priority: HIGHEST for action port [ 746.343329] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45ff18a7-4a73-49de-af36-6c1d70b047f6 with Priority: HIGHEST for action security_group_rules [ 746.343546] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45ff18a7-4a73-49de-af36-6c1d70b047f6 with Priority: HIGHEST for action security_group_members [ 746.344117] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38e61e10-04a7-4fca-ae7b-ad24c1de0978 with Priority: HIGHEST for action port [ 746.344554] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-45ff18a7-4a73-49de-af36-6c1d70b047f6 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.344707] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-45ff18a7-4a73-49de-af36-6c1d70b047f6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.344819] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-45ff18a7-4a73-49de-af36-6c1d70b047f6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.345310] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-45ff18a7-4a73-49de-af36-6c1d70b047f6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.345310] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('45ff18a7-4a73-49de-af36-6c1d70b047f6',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.347107] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-45ff18a7-4a73-49de-af36-6c1d70b047f6 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.347107] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45ff18a7-4a73-49de-af36-6c1d70b047f6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.347415] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-38e61e10-04a7-4fca-ae7b-ad24c1de0978 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.347608] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-38e61e10-04a7-4fca-ae7b-ad24c1de0978" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.347741] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-38e61e10-04a7-4fca-ae7b-ad24c1de0978" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.348139] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-38e61e10-04a7-4fca-ae7b-ad24c1de0978" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.348139] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('38e61e10-04a7-4fca-ae7b-ad24c1de0978',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.437225] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.437225] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.437225] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.437425] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.437495] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.437665] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.437758] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.437810] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.437939] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.437998] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.438150] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 83648dc4-e98f-47b1-b96c-2c0a05ebae74 is going to be updated. [ 746.468288] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.468452] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.468499] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.468706] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.468846] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.479804] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83648dc4-e98f-47b1-b96c-2c0a05ebae74 in Status: IN_PROGRESS for 2s [ 746.850420] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-45ff18a7-4a73-49de-af36-6c1d70b047f6 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.850818] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45ff18a7-4a73-49de-af36-6c1d70b047f6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.852942] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 38e61e10-04a7-4fca-ae7b-ad24c1de0978 with status ACTIVE [ 746.853176] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.853309] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.853378] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.853685] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.853685] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.853843] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.853967] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.853967] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.854124] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.854200] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.854471] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.854471] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.854809] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.854809] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.854809] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.854809] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 38e61e10-04a7-4fca-ae7b-ad24c1de0978 is going to be updated. [ 746.904020] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.904020] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.904020] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.904020] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.904020] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.904020] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-38e61e10-04a7-4fca-ae7b-ad24c1de0978" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.597195] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 83648dc4-e98f-47b1-b96c-2c0a05ebae74 in Status: SUCCESS [ 747.598024] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-83648dc4-e98f-47b1-b96c-2c0a05ebae74" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.717662] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a7006bfc-4bfa-49da-a51e-6cc26b8098c3 in Status: SUCCESS [ 747.717982] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a7006bfc-4bfa-49da-a51e-6cc26b8098c3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.898957] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6d7baac-4bff-46b9-b88d-2dc982621c0f in Status: SUCCESS [ 747.899697] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6d7baac-4bff-46b9-b88d-2dc982621c0f deletion is rescheduled due to dependency. [ 747.899697] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.115662] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45ff18a7-4a73-49de-af36-6c1d70b047f6 in Status: SUCCESS [ 748.115874] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45ff18a7-4a73-49de-af36-6c1d70b047f6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.116084] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45ff18a7-4a73-49de-af36-6c1d70b047f6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.116410] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45ff18a7-4a73-49de-af36-6c1d70b047f6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.116607] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.116735] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.116790] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.116939] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.117031] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.117133] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('45ff18a7-4a73-49de-af36-6c1d70b047f6',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.194558] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc04914d-716e-49e1-8a77-946f904f69bb in Status: SUCCESS [ 748.194827] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc04914d-716e-49e1-8a77-946f904f69bb deletion is rescheduled due to dependency. [ 748.194939] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc04914d-716e-49e1-8a77-946f904f69bb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.489926] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83648dc4-e98f-47b1-b96c-2c0a05ebae74 in Status: SUCCESS [ 748.490118] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 83648dc4-e98f-47b1-b96c-2c0a05ebae74 deletion is rescheduled due to dependency. [ 748.490228] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83648dc4-e98f-47b1-b96c-2c0a05ebae74" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.623054] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('45ff18a7-4a73-49de-af36-6c1d70b047f6',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.125406] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('45ff18a7-4a73-49de-af36-6c1d70b047f6',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.628223] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.628434] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.628554] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.628773] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.628865] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.629316] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45ff18a7-4a73-49de-af36-6c1d70b047f6 is going to be updated. [ 749.660071] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.661489] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.661489] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.661489] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.661489] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.670841] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45ff18a7-4a73-49de-af36-6c1d70b047f6 in Status: IN_PROGRESS for 2s [ 750.767524] env[65065]: INFO networking_nsxv3.common.synchronization [req-e7cf9482-4bf9-4d4c-95d8-46722cee63cf req-40bf0a1d-3b90-48b2-838a-c68a2c12326f tempest-ListImageFiltersTestJSON-354392293 tempest-ListImageFiltersTestJSON-354392293-project-member] Enqueued Resource ID: 1cb445c1-075d-4f89-884f-a4bbf84030d0 with Priority: HIGHEST for action security_group_members [ 750.768566] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cb445c1-075d-4f89-884f-a4bbf84030d0 with Priority: HIGHEST for action security_group_members [ 750.769125] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-1cb445c1-075d-4f89-884f-a4bbf84030d0 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.769457] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1cb445c1-075d-4f89-884f-a4bbf84030d0" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.769732] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1cb445c1-075d-4f89-884f-a4bbf84030d0" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.769826] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1cb445c1-075d-4f89-884f-a4bbf84030d0" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.770047] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.770256] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.770366] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.770629] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.770793] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.770924] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1cb445c1-075d-4f89-884f-a4bbf84030d0',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.273232] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1cb445c1-075d-4f89-884f-a4bbf84030d0',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.693222] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45ff18a7-4a73-49de-af36-6c1d70b047f6 in Status: SUCCESS [ 751.693222] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45ff18a7-4a73-49de-af36-6c1d70b047f6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.693222] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45ff18a7-4a73-49de-af36-6c1d70b047f6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.694235] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45ff18a7-4a73-49de-af36-6c1d70b047f6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.694235] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.694235] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.694235] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.694235] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.694530] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.694530] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45ff18a7-4a73-49de-af36-6c1d70b047f6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.694664] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('45ff18a7-4a73-49de-af36-6c1d70b047f6',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.779027] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1cb445c1-075d-4f89-884f-a4bbf84030d0',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.823664] env[65065]: INFO networking_nsxv3.common.synchronization [req-0506d0c1-f2e0-4cdc-8d5a-842e7d66ff2c req-9d84610f-5226-4454-8621-5120901b0725 tempest-SecurityGroupsTestJSON-312946932 tempest-SecurityGroupsTestJSON-312946932-project-member] Enqueued Resource ID: 99423afc-7fd3-4e3d-8a84-f190e0af048f with Priority: HIGHEST for action security_group_members [ 751.824210] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99423afc-7fd3-4e3d-8a84-f190e0af048f with Priority: HIGHEST for action security_group_members [ 751.824513] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-99423afc-7fd3-4e3d-8a84-f190e0af048f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.825075] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.825075] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.825075] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.825075] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.825285] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.825285] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.825346] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.825596] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.825596] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('99423afc-7fd3-4e3d-8a84-f190e0af048f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.200546] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-45ff18a7-4a73-49de-af36-6c1d70b047f6 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.200768] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45ff18a7-4a73-49de-af36-6c1d70b047f6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.200855] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45ff18a7-4a73-49de-af36-6c1d70b047f6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.201126] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45ff18a7-4a73-49de-af36-6c1d70b047f6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.201332] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.201436] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.201514] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.201681] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.201772] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.201896] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45ff18a7-4a73-49de-af36-6c1d70b047f6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.202035] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-45ff18a7-4a73-49de-af36-6c1d70b047f6 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.202141] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45ff18a7-4a73-49de-af36-6c1d70b047f6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.202201] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45ff18a7-4a73-49de-af36-6c1d70b047f6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.202359] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45ff18a7-4a73-49de-af36-6c1d70b047f6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.202510] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.202601] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.202661] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.202799] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.202878] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.202957] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45ff18a7-4a73-49de-af36-6c1d70b047f6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.203093] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('45ff18a7-4a73-49de-af36-6c1d70b047f6',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.228077] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock network-145 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.228366] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "network-145" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.228494] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "network-145" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.228750] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "network-145" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.229013] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.229181] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.229295] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.229502] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.229638] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.229838] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 752.229941] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 752.230057] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 752.230159] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 752.230258] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 752.230388] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 752.230524] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 752.256920] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 752.257145] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 752.257291] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 752.257463] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "network-145" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.257841] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock port-ed9e82b0-1d53-462b-8d54-46f1aecfdc64 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.258027] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "port-ed9e82b0-1d53-462b-8d54-46f1aecfdc64" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.258202] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "port-ed9e82b0-1d53-462b-8d54-46f1aecfdc64" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.258568] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "port-ed9e82b0-1d53-462b-8d54-46f1aecfdc64" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.258715] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ed9e82b0-1d53-462b-8d54-46f1aecfdc64',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.282245] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.282494] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.282579] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.282833] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.282978] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.283146] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1cb445c1-075d-4f89-884f-a4bbf84030d0 is going to be updated. [ 752.328093] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('99423afc-7fd3-4e3d-8a84-f190e0af048f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.335773] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.335977] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.336121] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.336426] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.336632] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.355943] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1cb445c1-075d-4f89-884f-a4bbf84030d0 in Status: IN_PROGRESS for 2s [ 752.705989] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 45ff18a7-4a73-49de-af36-6c1d70b047f6: rpc.has_security_group_logging(os_id): False [ 752.726297] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.726510] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.726510] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.726793] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.748297] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.748600] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.748721] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.748786] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.749220] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.749220] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.749464] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.749580] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.749646] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.749815] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.749894] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.750091] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.750186] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.750248] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.750393] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.750469] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.750552] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 45ff18a7-4a73-49de-af36-6c1d70b047f6 is going to be updated. [ 752.762019] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.762019] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.762019] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.762019] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.762019] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.762332] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Segment Port ed9e82b0-1d53-462b-8d54-46f1aecfdc64 not found, creating... [ 752.762454] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.762620] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.762748] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.763020] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.763162] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.763479] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.763646] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.763771] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.763995] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.764153] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.764305] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Resource: SegmentPort with ID: ed9e82b0-1d53-462b-8d54-46f1aecfdc64 is going to be created. [ 752.795034] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.795342] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.795429] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.796033] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.796033] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.796628] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "port-ed9e82b0-1d53-462b-8d54-46f1aecfdc64" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.830265] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('99423afc-7fd3-4e3d-8a84-f190e0af048f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.852622] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.852622] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.852908] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.853049] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.853168] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.873936] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 45ff18a7-4a73-49de-af36-6c1d70b047f6 in Status: IN_PROGRESS for 2s [ 753.333016] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.333194] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.333307] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.333653] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.333805] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.333966] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99423afc-7fd3-4e3d-8a84-f190e0af048f is going to be updated. [ 753.366396] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.366572] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.366650] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.366916] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.367119] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.379951] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99423afc-7fd3-4e3d-8a84-f190e0af048f in Status: IN_PROGRESS for 2s [ 753.558025] env[65065]: INFO networking_nsxv3.common.synchronization [req-0506d0c1-f2e0-4cdc-8d5a-842e7d66ff2c req-2e0311b0-3a73-4f85-ae36-a9f4d03f5bf3 service nova] Enqueued Resource ID: 99423afc-7fd3-4e3d-8a84-f190e0af048f with Priority: HIGHEST for action security_group_rules [ 753.558025] env[65065]: INFO networking_nsxv3.common.synchronization [req-0506d0c1-f2e0-4cdc-8d5a-842e7d66ff2c req-2e0311b0-3a73-4f85-ae36-a9f4d03f5bf3 service nova] Enqueued Resource ID: 99423afc-7fd3-4e3d-8a84-f190e0af048f with Priority: HIGHEST for action security_group_members [ 753.558025] env[65065]: INFO networking_nsxv3.common.synchronization [req-0506d0c1-f2e0-4cdc-8d5a-842e7d66ff2c req-2e0311b0-3a73-4f85-ae36-a9f4d03f5bf3 service nova] Enqueued Resource ID: ed9e82b0-1d53-462b-8d54-46f1aecfdc64 with Priority: HIGHEST for action port [ 753.558025] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99423afc-7fd3-4e3d-8a84-f190e0af048f with Priority: HIGHEST for action security_group_rules [ 753.558025] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99423afc-7fd3-4e3d-8a84-f190e0af048f with Priority: HIGHEST for action security_group_members [ 753.558444] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed9e82b0-1d53-462b-8d54-46f1aecfdc64 with Priority: HIGHEST for action port [ 753.558590] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-99423afc-7fd3-4e3d-8a84-f190e0af048f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.558883] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.558954] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.559198] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.559297] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('99423afc-7fd3-4e3d-8a84-f190e0af048f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.560224] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-99423afc-7fd3-4e3d-8a84-f190e0af048f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.560426] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.560533] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-ed9e82b0-1d53-462b-8d54-46f1aecfdc64 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.562222] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ed9e82b0-1d53-462b-8d54-46f1aecfdc64" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.562222] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ed9e82b0-1d53-462b-8d54-46f1aecfdc64" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.562222] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ed9e82b0-1d53-462b-8d54-46f1aecfdc64" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.562222] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ed9e82b0-1d53-462b-8d54-46f1aecfdc64',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.062863] env[65065]: INFO networking_nsxv3.common.synchronization [None req-39a2c97a-1008-4a3e-9927-da24afa58e83 None None] Enqueued Resource ID: 8d243086-36e2-447c-bbf8-d465c748c702 with Priority: HIGHEST for action port [ 754.063326] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-99423afc-7fd3-4e3d-8a84-f190e0af048f taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.063326] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.063552] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d243086-36e2-447c-bbf8-d465c748c702 with Priority: HIGHEST for action port [ 754.064072] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ed9e82b0-1d53-462b-8d54-46f1aecfdc64 with status ACTIVE [ 754.064072] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.064072] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.064072] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.064319] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.064372] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.064533] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.067933] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.068052] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.068346] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.068449] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.068701] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.068860] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.068956] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.069213] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.069348] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.069493] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ed9e82b0-1d53-462b-8d54-46f1aecfdc64 is going to be updated. [ 754.071011] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-8d243086-36e2-447c-bbf8-d465c748c702 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.071168] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8d243086-36e2-447c-bbf8-d465c748c702" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.071237] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8d243086-36e2-447c-bbf8-d465c748c702" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.071457] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8d243086-36e2-447c-bbf8-d465c748c702" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.071566] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8d243086-36e2-447c-bbf8-d465c748c702',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.096490] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.096849] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.096849] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.096948] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.097137] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.097245] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ed9e82b0-1d53-462b-8d54-46f1aecfdc64" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.380733] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1cb445c1-075d-4f89-884f-a4bbf84030d0 in Status: SUCCESS [ 754.380733] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1cb445c1-075d-4f89-884f-a4bbf84030d0" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.576672] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8d243086-36e2-447c-bbf8-d465c748c702 [ 754.576672] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.576672] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.576672] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.576672] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.576672] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.576672] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8d243086-36e2-447c-bbf8-d465c748c702 already deleted. [ 754.576672] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8d243086-36e2-447c-bbf8-d465c748c702" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.889847] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 45ff18a7-4a73-49de-af36-6c1d70b047f6 in Status: SUCCESS [ 754.891239] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-45ff18a7-4a73-49de-af36-6c1d70b047f6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.391991] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99423afc-7fd3-4e3d-8a84-f190e0af048f in Status: SUCCESS [ 755.391991] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.391991] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.391991] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.394104] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.395292] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.395409] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.395644] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.395747] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.395780] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('99423afc-7fd3-4e3d-8a84-f190e0af048f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.501495] env[65065]: INFO networking_nsxv3.common.synchronization [None req-ca7494ae-df4a-477a-a461-1fedf3998818 tempest-AttachInterfacesTestJSON-1590270829 tempest-AttachInterfacesTestJSON-1590270829-project-member] Enqueued Resource ID: 7299f16a-2557-464b-9f29-2b3b8469fc29 with Priority: HIGHEST for action security_group_rules [ 755.501862] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7299f16a-2557-464b-9f29-2b3b8469fc29 with Priority: HIGHEST for action security_group_rules [ 755.505136] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7299f16a-2557-464b-9f29-2b3b8469fc29 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.505136] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7299f16a-2557-464b-9f29-2b3b8469fc29" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.505136] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7299f16a-2557-464b-9f29-2b3b8469fc29" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.505136] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7299f16a-2557-464b-9f29-2b3b8469fc29" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.505136] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7299f16a-2557-464b-9f29-2b3b8469fc29',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.642034] env[65065]: INFO networking_nsxv3.common.synchronization [None req-dad6f582-a201-4d79-b54b-1edb6c6be1c6 tempest-AttachInterfacesTestJSON-1590270829 tempest-AttachInterfacesTestJSON-1590270829-project-member] Enqueued Resource ID: 7299f16a-2557-464b-9f29-2b3b8469fc29 with Priority: HIGHEST for action security_group_rules [ 755.642856] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7299f16a-2557-464b-9f29-2b3b8469fc29 with Priority: HIGHEST for action security_group_rules [ 755.642924] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7299f16a-2557-464b-9f29-2b3b8469fc29 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.643571] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7299f16a-2557-464b-9f29-2b3b8469fc29" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.898549] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('99423afc-7fd3-4e3d-8a84-f190e0af048f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.029930] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.030049] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.030103] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.030335] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.030408] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.030567] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7299f16a-2557-464b-9f29-2b3b8469fc29 already deleted. [ 756.030618] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7299f16a-2557-464b-9f29-2b3b8469fc29" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.030778] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7299f16a-2557-464b-9f29-2b3b8469fc29" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.031159] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7299f16a-2557-464b-9f29-2b3b8469fc29" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.031159] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7299f16a-2557-464b-9f29-2b3b8469fc29',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.403029] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('99423afc-7fd3-4e3d-8a84-f190e0af048f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.529517] env[65065]: INFO networking_nsxv3.common.synchronization [None req-708f805e-48a5-43c5-909b-207fc1f35e5c None None] Enqueued Resource ID: 10c7c412-d0fa-423a-a5a5-39c557400ebd with Priority: HIGHEST for action port [ 756.530309] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10c7c412-d0fa-423a-a5a5-39c557400ebd with Priority: HIGHEST for action port [ 756.530751] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-10c7c412-d0fa-423a-a5a5-39c557400ebd taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.530751] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-10c7c412-d0fa-423a-a5a5-39c557400ebd" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.530751] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-10c7c412-d0fa-423a-a5a5-39c557400ebd" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.531097] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-10c7c412-d0fa-423a-a5a5-39c557400ebd" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.531197] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('10c7c412-d0fa-423a-a5a5-39c557400ebd',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.555092] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.555264] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.556047] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.556047] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.556047] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.556047] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7299f16a-2557-464b-9f29-2b3b8469fc29 already deleted. [ 756.556047] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7299f16a-2557-464b-9f29-2b3b8469fc29" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.911324] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.911586] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.911721] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.912052] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.912607] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.912607] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99423afc-7fd3-4e3d-8a84-f190e0af048f is going to be updated. [ 756.946274] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.946428] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.946500] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.946716] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.947118] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.956848] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99423afc-7fd3-4e3d-8a84-f190e0af048f in Status: IN_PROGRESS for 2s [ 757.033160] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 10c7c412-d0fa-423a-a5a5-39c557400ebd [ 757.033535] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.033718] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.033800] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.034037] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.034117] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.034229] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:10c7c412-d0fa-423a-a5a5-39c557400ebd already deleted. [ 757.034314] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-10c7c412-d0fa-423a-a5a5-39c557400ebd" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.970646] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99423afc-7fd3-4e3d-8a84-f190e0af048f in Status: SUCCESS [ 758.971108] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.972503] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.972761] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.973083] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.973351] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.973411] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.973584] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.973671] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.973825] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.974255] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('99423afc-7fd3-4e3d-8a84-f190e0af048f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.478350] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-99423afc-7fd3-4e3d-8a84-f190e0af048f taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.478645] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.478758] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.479401] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.479729] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.479880] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.479974] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.480302] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.480857] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.481269] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.481269] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-99423afc-7fd3-4e3d-8a84-f190e0af048f taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.481269] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.481385] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.481486] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.481630] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.481738] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.481967] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.482342] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.482498] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.482671] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.482912] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('99423afc-7fd3-4e3d-8a84-f190e0af048f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.494491] env[65065]: INFO networking_nsxv3.common.synchronization [req-c5666be8-5a17-4766-90f4-d0fe26c6be91 req-475ef547-00d7-4273-a87f-c3560f57eca5 tempest-ServerGroupTestJSON-266849952 tempest-ServerGroupTestJSON-266849952-project-member] Enqueued Resource ID: 64777a42-07f5-4e1e-a53c-afd2accca690 with Priority: HIGHEST for action security_group_members [ 759.495329] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64777a42-07f5-4e1e-a53c-afd2accca690 with Priority: HIGHEST for action security_group_members [ 759.495666] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-64777a42-07f5-4e1e-a53c-afd2accca690 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.495822] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64777a42-07f5-4e1e-a53c-afd2accca690" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.495969] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64777a42-07f5-4e1e-a53c-afd2accca690" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.496273] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64777a42-07f5-4e1e-a53c-afd2accca690" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.496440] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.496596] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.496674] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.496835] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.496922] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.497028] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('64777a42-07f5-4e1e-a53c-afd2accca690',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.893764] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock network-707 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.894069] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "network-707" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.894197] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "network-707" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.894620] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "network-707" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.894887] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.895066] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.895229] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.895460] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.895639] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.896089] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 759.896089] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 759.896089] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 759.896205] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 759.896234] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 759.898351] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 759.898351] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 759.907080] env[65065]: INFO networking_nsxv3.common.synchronization [req-c92cac7a-91db-4680-81f8-0708edc57766 req-0c6fc41f-71e2-48d5-89cf-ca2e291c03ed tempest-ServersAdminTestJSON-1746807080 tempest-ServersAdminTestJSON-1746807080-project-member] Enqueued Resource ID: ed4053b7-493c-48f8-b82e-b002cbcc3a61 with Priority: HIGHEST for action security_group_members [ 759.908511] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed4053b7-493c-48f8-b82e-b002cbcc3a61 with Priority: HIGHEST for action security_group_members [ 759.908840] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed4053b7-493c-48f8-b82e-b002cbcc3a61 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.908974] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.909068] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.909371] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.909542] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.909678] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.909736] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.909897] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.910141] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.910141] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ed4053b7-493c-48f8-b82e-b002cbcc3a61',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.919128] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 759.919998] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 759.919998] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 759.919998] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "network-707" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.919998] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock port-1c108cc9-4759-4d40-acdb-882347c6629d taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.920273] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "port-1c108cc9-4759-4d40-acdb-882347c6629d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.920273] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "port-1c108cc9-4759-4d40-acdb-882347c6629d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.920695] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "port-1c108cc9-4759-4d40-acdb-882347c6629d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.920774] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1c108cc9-4759-4d40-acdb-882347c6629d',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.986401] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 99423afc-7fd3-4e3d-8a84-f190e0af048f: rpc.has_security_group_logging(os_id): False [ 759.999553] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.999718] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.999792] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.000013] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.000105] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.000313] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.000456] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.000456] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.000610] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.000683] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.000767] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64777a42-07f5-4e1e-a53c-afd2accca690 already deleted. [ 760.000845] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64777a42-07f5-4e1e-a53c-afd2accca690" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.012841] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.013025] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.013093] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.013287] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.037982] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.037982] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.037982] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.037982] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.037982] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.037982] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.037982] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.037982] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.037982] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.037982] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.037982] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.037982] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.037982] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.037982] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.038569] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.038569] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.038569] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 99423afc-7fd3-4e3d-8a84-f190e0af048f is going to be updated. [ 760.041779] env[65065]: INFO networking_nsxv3.common.synchronization [None req-272fabcd-9eca-4ba2-9116-e5f6dd46e6db None None] Enqueued Resource ID: 2511c8bb-b2b6-43e2-9119-63518cfd0fc9 with Priority: HIGHEST for action port [ 760.042309] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2511c8bb-b2b6-43e2-9119-63518cfd0fc9 with Priority: HIGHEST for action port [ 760.043073] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-2511c8bb-b2b6-43e2-9119-63518cfd0fc9 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.043073] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2511c8bb-b2b6-43e2-9119-63518cfd0fc9" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.043073] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2511c8bb-b2b6-43e2-9119-63518cfd0fc9" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.043304] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2511c8bb-b2b6-43e2-9119-63518cfd0fc9" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.043304] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2511c8bb-b2b6-43e2-9119-63518cfd0fc9',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.107366] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.107504] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.107574] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.107788] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.109292] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.125804] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 99423afc-7fd3-4e3d-8a84-f190e0af048f in Status: IN_PROGRESS for 2s [ 760.413344] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ed4053b7-493c-48f8-b82e-b002cbcc3a61',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.425225] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.426329] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.426329] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.426329] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.426329] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.426329] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Segment Port 1c108cc9-4759-4d40-acdb-882347c6629d not found, creating... [ 760.426745] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.426836] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.426887] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.427130] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.427385] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.427648] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.427799] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.428099] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.428186] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.428435] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.428569] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Resource: SegmentPort with ID: 1c108cc9-4759-4d40-acdb-882347c6629d is going to be created. [ 760.451396] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.452341] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.452549] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.452829] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.453065] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.453383] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "port-1c108cc9-4759-4d40-acdb-882347c6629d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.546257] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2511c8bb-b2b6-43e2-9119-63518cfd0fc9 [ 760.547814] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.547814] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.547814] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.547814] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.547814] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.547814] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2511c8bb-b2b6-43e2-9119-63518cfd0fc9 already deleted. [ 760.547814] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2511c8bb-b2b6-43e2-9119-63518cfd0fc9" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.915293] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ed4053b7-493c-48f8-b82e-b002cbcc3a61',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.248246] env[65065]: INFO networking_nsxv3.common.synchronization [req-c5666be8-5a17-4766-90f4-d0fe26c6be91 req-b99950cd-5c7a-416b-b07a-85fd971cffd9 service nova] Enqueued Resource ID: 64777a42-07f5-4e1e-a53c-afd2accca690 with Priority: HIGHEST for action security_group_rules [ 761.248246] env[65065]: INFO networking_nsxv3.common.synchronization [req-c5666be8-5a17-4766-90f4-d0fe26c6be91 req-b99950cd-5c7a-416b-b07a-85fd971cffd9 service nova] Enqueued Resource ID: 64777a42-07f5-4e1e-a53c-afd2accca690 with Priority: HIGHEST for action security_group_members [ 761.248246] env[65065]: INFO networking_nsxv3.common.synchronization [req-c5666be8-5a17-4766-90f4-d0fe26c6be91 req-b99950cd-5c7a-416b-b07a-85fd971cffd9 service nova] Enqueued Resource ID: 1c108cc9-4759-4d40-acdb-882347c6629d with Priority: HIGHEST for action port [ 761.248246] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64777a42-07f5-4e1e-a53c-afd2accca690 with Priority: HIGHEST for action security_group_rules [ 761.248246] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64777a42-07f5-4e1e-a53c-afd2accca690 with Priority: HIGHEST for action security_group_members [ 761.248246] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c108cc9-4759-4d40-acdb-882347c6629d with Priority: HIGHEST for action port [ 761.252272] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-64777a42-07f5-4e1e-a53c-afd2accca690 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.252355] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-64777a42-07f5-4e1e-a53c-afd2accca690" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.252391] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-64777a42-07f5-4e1e-a53c-afd2accca690" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.252796] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-64777a42-07f5-4e1e-a53c-afd2accca690" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.252880] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('64777a42-07f5-4e1e-a53c-afd2accca690',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.253873] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-64777a42-07f5-4e1e-a53c-afd2accca690 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.253985] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64777a42-07f5-4e1e-a53c-afd2accca690" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.254061] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64777a42-07f5-4e1e-a53c-afd2accca690" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.254238] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64777a42-07f5-4e1e-a53c-afd2accca690" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.254388] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.254495] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.254570] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.254716] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.254809] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.254904] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('64777a42-07f5-4e1e-a53c-afd2accca690',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.255754] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-1c108cc9-4759-4d40-acdb-882347c6629d taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.255873] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1c108cc9-4759-4d40-acdb-882347c6629d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.255924] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1c108cc9-4759-4d40-acdb-882347c6629d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.260023] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1c108cc9-4759-4d40-acdb-882347c6629d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.260023] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1c108cc9-4759-4d40-acdb-882347c6629d',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.418213] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.418427] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.418497] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.418713] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.418804] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.418948] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ed4053b7-493c-48f8-b82e-b002cbcc3a61 is going to be updated. [ 761.459449] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.459692] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.459755] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.459974] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.460091] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.480243] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed4053b7-493c-48f8-b82e-b002cbcc3a61 in Status: IN_PROGRESS for 2s [ 761.759966] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('64777a42-07f5-4e1e-a53c-afd2accca690',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.764514] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-64777a42-07f5-4e1e-a53c-afd2accca690 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.764514] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64777a42-07f5-4e1e-a53c-afd2accca690" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.764514] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1c108cc9-4759-4d40-acdb-882347c6629d with status ACTIVE [ 761.764514] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.764514] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.764514] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.764514] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.764514] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.764514] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.764514] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.764514] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.764514] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.765074] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.765110] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.765218] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.765327] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.765460] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.765596] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.765627] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1c108cc9-4759-4d40-acdb-882347c6629d is going to be updated. [ 761.798427] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.799493] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.799493] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.799493] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.799681] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.799757] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1c108cc9-4759-4d40-acdb-882347c6629d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.142955] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 99423afc-7fd3-4e3d-8a84-f190e0af048f in Status: SUCCESS [ 762.143198] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.268097] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('64777a42-07f5-4e1e-a53c-afd2accca690',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.498791] env[65065]: INFO networking_nsxv3.common.synchronization [None req-80f8244f-b3ac-40ee-a2e8-4a608e192133 None None] Enqueued Resource ID: f6617d44-f16c-4bf2-ad83-6dafa75bd89c with Priority: HIGHEST for action port [ 762.499420] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6617d44-f16c-4bf2-ad83-6dafa75bd89c with Priority: HIGHEST for action port [ 762.499726] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-f6617d44-f16c-4bf2-ad83-6dafa75bd89c taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.499855] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f6617d44-f16c-4bf2-ad83-6dafa75bd89c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.499950] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f6617d44-f16c-4bf2-ad83-6dafa75bd89c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.500523] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f6617d44-f16c-4bf2-ad83-6dafa75bd89c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.500638] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f6617d44-f16c-4bf2-ad83-6dafa75bd89c',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.658025] env[65065]: INFO networking_nsxv3.common.synchronization [req-eb6482c7-457f-4c65-b657-e1791bd88dc4 req-2570310e-4a40-4b1f-b20b-f88814d0f083 tempest-ServerDiskConfigTestJSON-975440465 tempest-ServerDiskConfigTestJSON-975440465-project-member] Enqueued Resource ID: ffd44fac-c762-408c-862b-ccea34e00947 with Priority: HIGHEST for action security_group_members [ 762.658186] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ffd44fac-c762-408c-862b-ccea34e00947 with Priority: HIGHEST for action security_group_members [ 762.658718] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-ffd44fac-c762-408c-862b-ccea34e00947 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.658869] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.658941] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.659204] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.659480] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.659705] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.659781] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.659951] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.660055] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.660150] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ffd44fac-c762-408c-862b-ccea34e00947',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.772101] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.772283] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.772328] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.772738] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.772802] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.772874] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64777a42-07f5-4e1e-a53c-afd2accca690 is going to be created. [ 762.802684] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.802888] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.802929] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.803149] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.803313] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.814550] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64777a42-07f5-4e1e-a53c-afd2accca690 in Status: UNINITIALIZED for 2s [ 763.004151] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f6617d44-f16c-4bf2-ad83-6dafa75bd89c [ 763.004408] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.004558] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.004640] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.004842] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.004935] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.005042] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f6617d44-f16c-4bf2-ad83-6dafa75bd89c already deleted. [ 763.005123] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f6617d44-f16c-4bf2-ad83-6dafa75bd89c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.162088] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.162260] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.162383] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.162556] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.162664] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.164452] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.164452] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.164452] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.164452] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.164452] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.164738] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ffd44fac-c762-408c-862b-ccea34e00947 is going to be updated. [ 763.206369] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.206593] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.206652] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.206851] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.206989] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.221572] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ffd44fac-c762-408c-862b-ccea34e00947 in Status: IN_PROGRESS for 2s [ 763.492799] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed4053b7-493c-48f8-b82e-b002cbcc3a61 in Status: SUCCESS [ 763.493177] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.591740] env[65065]: INFO networking_nsxv3.common.synchronization [req-ff33074e-ebed-4a5e-91da-5aff1bb38a0d req-dcb57cbc-1356-47fc-8d68-237d5dff005a tempest-ServerDiagnosticsNegativeTest-2091454356 tempest-ServerDiagnosticsNegativeTest-2091454356-project-member] Enqueued Resource ID: 5e981dae-b2fb-4490-8e25-4c38eb726ea5 with Priority: HIGHEST for action security_group_members [ 763.592012] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e981dae-b2fb-4490-8e25-4c38eb726ea5 with Priority: HIGHEST for action security_group_members [ 763.592319] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e981dae-b2fb-4490-8e25-4c38eb726ea5 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.592458] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e981dae-b2fb-4490-8e25-4c38eb726ea5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.592528] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e981dae-b2fb-4490-8e25-4c38eb726ea5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.592769] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e981dae-b2fb-4490-8e25-4c38eb726ea5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.592922] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.593150] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.593235] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.594117] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.594117] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.594117] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e981dae-b2fb-4490-8e25-4c38eb726ea5',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.889139] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock network-11 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.889346] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "network-11" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.889466] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "network-11" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.889736] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "network-11" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.890068] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.890181] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.890571] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.890571] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.890571] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.891069] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 763.891069] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 763.891069] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 763.891069] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 763.891234] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 763.891264] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 763.891711] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 763.914357] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 763.914523] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 763.914661] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 763.916022] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "network-11" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.916022] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock port-9b6549dc-6907-4148-80dc-246aa2f5ecf8 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.916022] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "port-9b6549dc-6907-4148-80dc-246aa2f5ecf8" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.916022] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "port-9b6549dc-6907-4148-80dc-246aa2f5ecf8" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.916022] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "port-9b6549dc-6907-4148-80dc-246aa2f5ecf8" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.916290] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9b6549dc-6907-4148-80dc-246aa2f5ecf8',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.096346] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.096346] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.096346] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.096346] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.096346] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.096646] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.096646] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.096722] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.097697] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.097697] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.097697] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e981dae-b2fb-4490-8e25-4c38eb726ea5 already deleted. [ 764.097697] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e981dae-b2fb-4490-8e25-4c38eb726ea5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.240100] env[65065]: INFO networking_nsxv3.common.synchronization [req-acab39c5-e94e-4a22-a721-8d69e17c7a8c req-d79957d5-c9f8-4fdb-898b-0bb7aae922e6 tempest-SecurityGroupsTestJSON-312946932 tempest-SecurityGroupsTestJSON-312946932-project-member] Enqueued Resource ID: 6c6d05e2-e80c-477f-9eea-12f17d58d439 with Priority: HIGHEST for action security_group_members [ 764.240278] env[65065]: INFO networking_nsxv3.common.synchronization [req-acab39c5-e94e-4a22-a721-8d69e17c7a8c req-d79957d5-c9f8-4fdb-898b-0bb7aae922e6 tempest-SecurityGroupsTestJSON-312946932 tempest-SecurityGroupsTestJSON-312946932-project-member] Enqueued Resource ID: 99423afc-7fd3-4e3d-8a84-f190e0af048f with Priority: HIGHEST for action security_group_members [ 764.240896] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c6d05e2-e80c-477f-9eea-12f17d58d439 with Priority: HIGHEST for action security_group_members [ 764.241134] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99423afc-7fd3-4e3d-8a84-f190e0af048f with Priority: HIGHEST for action security_group_members [ 764.241478] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c6d05e2-e80c-477f-9eea-12f17d58d439 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.241649] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c6d05e2-e80c-477f-9eea-12f17d58d439" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.241747] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c6d05e2-e80c-477f-9eea-12f17d58d439" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.242037] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c6d05e2-e80c-477f-9eea-12f17d58d439" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.242264] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.242409] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.242505] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.242689] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.242826] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.242970] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6c6d05e2-e80c-477f-9eea-12f17d58d439',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.243864] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-99423afc-7fd3-4e3d-8a84-f190e0af048f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.244024] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.244123] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.244320] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.244528] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.244675] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.244770] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.244944] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.245093] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.245221] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('99423afc-7fd3-4e3d-8a84-f190e0af048f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.290024] env[65065]: INFO networking_nsxv3.common.synchronization [req-acab39c5-e94e-4a22-a721-8d69e17c7a8c req-d79957d5-c9f8-4fdb-898b-0bb7aae922e6 tempest-SecurityGroupsTestJSON-312946932 tempest-SecurityGroupsTestJSON-312946932-project-member] Enqueued Resource ID: 6c6d05e2-e80c-477f-9eea-12f17d58d439 with Priority: HIGHEST for action security_group_rules [ 764.290024] env[65065]: INFO networking_nsxv3.common.synchronization [req-acab39c5-e94e-4a22-a721-8d69e17c7a8c req-d79957d5-c9f8-4fdb-898b-0bb7aae922e6 tempest-SecurityGroupsTestJSON-312946932 tempest-SecurityGroupsTestJSON-312946932-project-member] Enqueued Resource ID: 6c6d05e2-e80c-477f-9eea-12f17d58d439 with Priority: HIGHEST for action security_group_members [ 764.290024] env[65065]: INFO networking_nsxv3.common.synchronization [req-acab39c5-e94e-4a22-a721-8d69e17c7a8c req-d79957d5-c9f8-4fdb-898b-0bb7aae922e6 tempest-SecurityGroupsTestJSON-312946932 tempest-SecurityGroupsTestJSON-312946932-project-member] Enqueued Resource ID: 99423afc-7fd3-4e3d-8a84-f190e0af048f with Priority: HIGHEST for action security_group_rules [ 764.290024] env[65065]: INFO networking_nsxv3.common.synchronization [req-acab39c5-e94e-4a22-a721-8d69e17c7a8c req-d79957d5-c9f8-4fdb-898b-0bb7aae922e6 tempest-SecurityGroupsTestJSON-312946932 tempest-SecurityGroupsTestJSON-312946932-project-member] Enqueued Resource ID: 99423afc-7fd3-4e3d-8a84-f190e0af048f with Priority: HIGHEST for action security_group_members [ 764.290024] env[65065]: INFO networking_nsxv3.common.synchronization [req-acab39c5-e94e-4a22-a721-8d69e17c7a8c req-d79957d5-c9f8-4fdb-898b-0bb7aae922e6 tempest-SecurityGroupsTestJSON-312946932 tempest-SecurityGroupsTestJSON-312946932-project-member] Enqueued Resource ID: ed9e82b0-1d53-462b-8d54-46f1aecfdc64 with Priority: HIGHEST for action port [ 764.290024] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c6d05e2-e80c-477f-9eea-12f17d58d439 with Priority: HIGHEST for action security_group_rules [ 764.290024] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99423afc-7fd3-4e3d-8a84-f190e0af048f with Priority: HIGHEST for action security_group_rules [ 764.290024] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed9e82b0-1d53-462b-8d54-46f1aecfdc64 with Priority: HIGHEST for action port [ 764.290551] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c6d05e2-e80c-477f-9eea-12f17d58d439 with Priority: HIGHEST for action security_group_members [ 764.290874] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99423afc-7fd3-4e3d-8a84-f190e0af048f with Priority: HIGHEST for action security_group_members [ 764.291345] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6c6d05e2-e80c-477f-9eea-12f17d58d439 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.291605] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6c6d05e2-e80c-477f-9eea-12f17d58d439" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.291782] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6c6d05e2-e80c-477f-9eea-12f17d58d439" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.292120] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6c6d05e2-e80c-477f-9eea-12f17d58d439" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.292295] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6c6d05e2-e80c-477f-9eea-12f17d58d439',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.293316] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-99423afc-7fd3-4e3d-8a84-f190e0af048f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.293558] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.293724] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.293977] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.294175] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('99423afc-7fd3-4e3d-8a84-f190e0af048f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.298562] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-ed9e82b0-1d53-462b-8d54-46f1aecfdc64 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.298562] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ed9e82b0-1d53-462b-8d54-46f1aecfdc64" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.298562] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ed9e82b0-1d53-462b-8d54-46f1aecfdc64" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.298562] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ed9e82b0-1d53-462b-8d54-46f1aecfdc64" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.298562] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ed9e82b0-1d53-462b-8d54-46f1aecfdc64',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.298562] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c6d05e2-e80c-477f-9eea-12f17d58d439 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.298562] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c6d05e2-e80c-477f-9eea-12f17d58d439" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.298562] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-99423afc-7fd3-4e3d-8a84-f190e0af048f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.298562] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.418287] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.418558] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.418683] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.419641] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.419641] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.419641] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Segment Port 9b6549dc-6907-4148-80dc-246aa2f5ecf8 not found, creating... [ 764.419909] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.420086] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.420204] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.420447] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.420577] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.420873] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.421262] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.421262] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.421384] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.421472] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.421608] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Resource: SegmentPort with ID: 9b6549dc-6907-4148-80dc-246aa2f5ecf8 is going to be created. [ 764.443965] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.444191] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.444310] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.445879] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.445879] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.445879] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "port-9b6549dc-6907-4148-80dc-246aa2f5ecf8" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.746873] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6c6d05e2-e80c-477f-9eea-12f17d58d439',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.747987] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('99423afc-7fd3-4e3d-8a84-f190e0af048f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.798543] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ed9e82b0-1d53-462b-8d54-46f1aecfdc64 with status ACTIVE [ 764.799306] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.799306] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.799306] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.799568] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.799568] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.799784] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.799901] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.799966] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.800671] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.800671] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.800671] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.800671] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.800951] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.800951] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.801102] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.801102] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ed9e82b0-1d53-462b-8d54-46f1aecfdc64 is going to be updated. [ 764.802970] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c6d05e2-e80c-477f-9eea-12f17d58d439 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.802970] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c6d05e2-e80c-477f-9eea-12f17d58d439" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.802970] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-99423afc-7fd3-4e3d-8a84-f190e0af048f taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.802970] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.831287] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64777a42-07f5-4e1e-a53c-afd2accca690 in Status: SUCCESS [ 764.831501] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64777a42-07f5-4e1e-a53c-afd2accca690" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.831668] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64777a42-07f5-4e1e-a53c-afd2accca690" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.831890] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64777a42-07f5-4e1e-a53c-afd2accca690" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.832113] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.832209] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.832357] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.832418] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.832538] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.832577] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64777a42-07f5-4e1e-a53c-afd2accca690" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.832651] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('64777a42-07f5-4e1e-a53c-afd2accca690',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.844128] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.844260] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.844471] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.844537] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.844671] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.844834] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ed9e82b0-1d53-462b-8d54-46f1aecfdc64" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.090855] env[65065]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-5dc288ef-8933-4403-998f-272fe36b910d None None] NSXv3 Agent Agent loop - iteration:0 completed [ 765.091023] env[65065]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-5dc288ef-8933-4403-998f-272fe36b910d None None] NSXv3 Agent Agent loop - iteration:1 started [ 765.199332] env[65065]: INFO networking_nsxv3.common.synchronization [req-ff33074e-ebed-4a5e-91da-5aff1bb38a0d req-d6ef21c3-d95e-4de8-b6f5-2923d66e8628 service nova] Enqueued Resource ID: 5e981dae-b2fb-4490-8e25-4c38eb726ea5 with Priority: HIGHEST for action security_group_rules [ 765.199610] env[65065]: INFO networking_nsxv3.common.synchronization [req-ff33074e-ebed-4a5e-91da-5aff1bb38a0d req-d6ef21c3-d95e-4de8-b6f5-2923d66e8628 service nova] Enqueued Resource ID: 5e981dae-b2fb-4490-8e25-4c38eb726ea5 with Priority: HIGHEST for action security_group_members [ 765.201814] env[65065]: INFO networking_nsxv3.common.synchronization [req-ff33074e-ebed-4a5e-91da-5aff1bb38a0d req-d6ef21c3-d95e-4de8-b6f5-2923d66e8628 service nova] Enqueued Resource ID: 9b6549dc-6907-4148-80dc-246aa2f5ecf8 with Priority: HIGHEST for action port [ 765.202406] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e981dae-b2fb-4490-8e25-4c38eb726ea5 with Priority: HIGHEST for action security_group_rules [ 765.202539] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e981dae-b2fb-4490-8e25-4c38eb726ea5 with Priority: HIGHEST for action security_group_members [ 765.202640] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b6549dc-6907-4148-80dc-246aa2f5ecf8 with Priority: HIGHEST for action port [ 765.202926] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5e981dae-b2fb-4490-8e25-4c38eb726ea5 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.203080] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5e981dae-b2fb-4490-8e25-4c38eb726ea5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.203146] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5e981dae-b2fb-4490-8e25-4c38eb726ea5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.203424] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5e981dae-b2fb-4490-8e25-4c38eb726ea5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.203561] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5e981dae-b2fb-4490-8e25-4c38eb726ea5',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.205683] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e981dae-b2fb-4490-8e25-4c38eb726ea5 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.205811] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e981dae-b2fb-4490-8e25-4c38eb726ea5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.205879] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e981dae-b2fb-4490-8e25-4c38eb726ea5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.206105] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e981dae-b2fb-4490-8e25-4c38eb726ea5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.206300] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.206489] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.206489] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.206691] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.206691] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.206834] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e981dae-b2fb-4490-8e25-4c38eb726ea5',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.207742] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-9b6549dc-6907-4148-80dc-246aa2f5ecf8 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.207902] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9b6549dc-6907-4148-80dc-246aa2f5ecf8" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.207902] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9b6549dc-6907-4148-80dc-246aa2f5ecf8" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.208083] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9b6549dc-6907-4148-80dc-246aa2f5ecf8" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.208330] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9b6549dc-6907-4148-80dc-246aa2f5ecf8',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.234639] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ffd44fac-c762-408c-862b-ccea34e00947 in Status: SUCCESS [ 765.234884] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ffd44fac-c762-408c-862b-ccea34e00947 deletion is rescheduled due to dependency. [ 765.235380] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.251969] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6c6d05e2-e80c-477f-9eea-12f17d58d439',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.253353] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('99423afc-7fd3-4e3d-8a84-f190e0af048f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.334939] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-64777a42-07f5-4e1e-a53c-afd2accca690 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.336438] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64777a42-07f5-4e1e-a53c-afd2accca690" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.336507] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64777a42-07f5-4e1e-a53c-afd2accca690" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.336767] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64777a42-07f5-4e1e-a53c-afd2accca690" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.337280] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.338040] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.338040] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.338040] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.340277] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.340501] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64777a42-07f5-4e1e-a53c-afd2accca690" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.340732] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-64777a42-07f5-4e1e-a53c-afd2accca690 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.340869] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64777a42-07f5-4e1e-a53c-afd2accca690" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.340950] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64777a42-07f5-4e1e-a53c-afd2accca690" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.341316] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64777a42-07f5-4e1e-a53c-afd2accca690" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.341501] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.341608] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.341689] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.342604] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.342604] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.342604] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64777a42-07f5-4e1e-a53c-afd2accca690" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.342604] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('64777a42-07f5-4e1e-a53c-afd2accca690',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.711516] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e981dae-b2fb-4490-8e25-4c38eb726ea5 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.711713] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e981dae-b2fb-4490-8e25-4c38eb726ea5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.718578] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5e981dae-b2fb-4490-8e25-4c38eb726ea5',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.721890] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9b6549dc-6907-4148-80dc-246aa2f5ecf8 with status ACTIVE [ 765.721890] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.721890] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.721890] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.721890] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.721890] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.721890] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.721890] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.721890] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.722498] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.722498] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.722498] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.722498] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.722498] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.722853] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.722853] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.722853] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9b6549dc-6907-4148-80dc-246aa2f5ecf8 is going to be updated. [ 765.753527] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.754055] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.754055] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.754137] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.754500] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.755537] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9b6549dc-6907-4148-80dc-246aa2f5ecf8" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.755537] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.755537] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.755806] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.755806] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.755880] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.756076] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c6d05e2-e80c-477f-9eea-12f17d58d439 is going to be created. [ 765.758172] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.758411] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.758580] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.758965] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.759171] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.759403] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99423afc-7fd3-4e3d-8a84-f190e0af048f is going to be updated. [ 765.798590] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.798590] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.798590] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.798590] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.798776] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.806732] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.806889] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.807014] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.807361] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.807446] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.814586] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c6d05e2-e80c-477f-9eea-12f17d58d439 in Status: UNINITIALIZED for 2s [ 765.823581] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99423afc-7fd3-4e3d-8a84-f190e0af048f in Status: IN_PROGRESS for 2s [ 765.845354] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 64777a42-07f5-4e1e-a53c-afd2accca690: rpc.has_security_group_logging(os_id): False [ 765.866944] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.867215] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.867345] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.867642] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.867785] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.868094] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.868324] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.868404] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.868614] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.868646] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.868873] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.868925] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.868990] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.869211] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.869211] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.869583] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.869583] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.869583] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.869740] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.869740] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.869796] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 64777a42-07f5-4e1e-a53c-afd2accca690 is going to be created. [ 765.967085] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.968945] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.968945] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.969319] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.969604] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.984394] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 64777a42-07f5-4e1e-a53c-afd2accca690 in Status: IN_PROGRESS for 2s [ 766.062079] env[65065]: INFO networking_nsxv3.common.synchronization [req-a1f504da-272b-469b-8a6c-2ff61911005c req-f53367a5-eae7-46a0-bf75-776556e2a649 tempest-DeleteServersTestJSON-1316666736 tempest-DeleteServersTestJSON-1316666736-project-member] Enqueued Resource ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 with Priority: HIGHEST for action security_group_members [ 766.062613] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 with Priority: HIGHEST for action security_group_members [ 766.062849] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d0941d4-57d8-45e9-9f2f-95128b8136e5 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.062969] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.063919] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.064594] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.064836] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.064979] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.065095] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.065771] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.065900] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.066070] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d0941d4-57d8-45e9-9f2f-95128b8136e5',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.224777] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5e981dae-b2fb-4490-8e25-4c38eb726ea5',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.417379] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock network-950 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.417564] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "network-950" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.417682] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "network-950" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.418022] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "network-950" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.418295] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.418464] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.418577] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.418791] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.418933] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.420534] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 766.420534] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 766.420534] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 766.420534] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 766.420534] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 766.420534] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 766.420534] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 766.440652] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 766.440751] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 766.440881] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 766.441053] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "network-950" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.441359] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock port-765c6c90-a03d-493c-b8a2-6f3983207e5b taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.441518] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "port-765c6c90-a03d-493c-b8a2-6f3983207e5b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.445848] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "port-765c6c90-a03d-493c-b8a2-6f3983207e5b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.445848] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "port-765c6c90-a03d-493c-b8a2-6f3983207e5b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.445848] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('765c6c90-a03d-493c-b8a2-6f3983207e5b',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.568715] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.569179] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.569179] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.569179] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.569400] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.569557] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.569642] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.569642] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.569779] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.569855] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.569939] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 already deleted. [ 766.570031] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.727667] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.727667] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.727667] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.727975] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.727975] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.728144] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e981dae-b2fb-4490-8e25-4c38eb726ea5 is going to be created. [ 766.754258] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.754258] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.754258] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.754258] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.754258] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.763780] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e981dae-b2fb-4490-8e25-4c38eb726ea5 in Status: UNINITIALIZED for 2s [ 766.947786] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.948055] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.948197] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.948615] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.948763] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.948931] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Segment Port 765c6c90-a03d-493c-b8a2-6f3983207e5b not found, creating... [ 766.949255] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.949433] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.949549] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.950029] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.950804] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.950804] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.950804] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.950804] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.951055] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.951138] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.951288] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Resource: SegmentPort with ID: 765c6c90-a03d-493c-b8a2-6f3983207e5b is going to be created. [ 766.983227] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.983620] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.983772] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.984156] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.984426] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.984669] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "port-765c6c90-a03d-493c-b8a2-6f3983207e5b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.798856] env[65065]: INFO networking_nsxv3.common.synchronization [req-a1f504da-272b-469b-8a6c-2ff61911005c req-4fca5504-001a-45c6-86d0-61a309d2e35e service nova] Enqueued Resource ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 with Priority: HIGHEST for action security_group_rules [ 767.798856] env[65065]: INFO networking_nsxv3.common.synchronization [req-a1f504da-272b-469b-8a6c-2ff61911005c req-4fca5504-001a-45c6-86d0-61a309d2e35e service nova] Enqueued Resource ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 with Priority: HIGHEST for action security_group_members [ 767.798856] env[65065]: INFO networking_nsxv3.common.synchronization [req-a1f504da-272b-469b-8a6c-2ff61911005c req-4fca5504-001a-45c6-86d0-61a309d2e35e service nova] Enqueued Resource ID: 765c6c90-a03d-493c-b8a2-6f3983207e5b with Priority: HIGHEST for action port [ 767.799576] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 with Priority: HIGHEST for action security_group_rules [ 767.799576] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 with Priority: HIGHEST for action security_group_members [ 767.799576] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 765c6c90-a03d-493c-b8a2-6f3983207e5b with Priority: HIGHEST for action port [ 767.799813] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7d0941d4-57d8-45e9-9f2f-95128b8136e5 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.800059] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.800059] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.801595] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.801693] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7d0941d4-57d8-45e9-9f2f-95128b8136e5',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.802736] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d0941d4-57d8-45e9-9f2f-95128b8136e5 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.802894] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.803038] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.803157] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.803316] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.803431] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.803503] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.803647] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.806493] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.806760] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d0941d4-57d8-45e9-9f2f-95128b8136e5',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.811438] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-765c6c90-a03d-493c-b8a2-6f3983207e5b taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.811438] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-765c6c90-a03d-493c-b8a2-6f3983207e5b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.811886] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-765c6c90-a03d-493c-b8a2-6f3983207e5b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.811886] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-765c6c90-a03d-493c-b8a2-6f3983207e5b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.811886] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('765c6c90-a03d-493c-b8a2-6f3983207e5b',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.834551] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c6d05e2-e80c-477f-9eea-12f17d58d439 in Status: SUCCESS [ 767.835355] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c6d05e2-e80c-477f-9eea-12f17d58d439" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.835355] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c6d05e2-e80c-477f-9eea-12f17d58d439" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.835355] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c6d05e2-e80c-477f-9eea-12f17d58d439" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.835725] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.835725] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.835725] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.836188] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.836300] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.836436] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6c6d05e2-e80c-477f-9eea-12f17d58d439',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.839256] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99423afc-7fd3-4e3d-8a84-f190e0af048f in Status: SUCCESS [ 767.839512] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.840820] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.841146] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.841439] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.841580] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.841987] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.841987] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.841987] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.842227] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('99423afc-7fd3-4e3d-8a84-f190e0af048f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.998686] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 64777a42-07f5-4e1e-a53c-afd2accca690 in Status: SUCCESS [ 767.998819] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-64777a42-07f5-4e1e-a53c-afd2accca690" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.316305] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d0941d4-57d8-45e9-9f2f-95128b8136e5 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.316305] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.320764] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7d0941d4-57d8-45e9-9f2f-95128b8136e5',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.321520] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 765c6c90-a03d-493c-b8a2-6f3983207e5b with status ACTIVE [ 768.321739] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.321885] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.321954] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.322147] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.322322] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.322598] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.322722] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.322783] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.323940] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.323940] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.323940] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.323940] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.323940] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.323940] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.323940] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.324419] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 765c6c90-a03d-493c-b8a2-6f3983207e5b is going to be updated. [ 768.345987] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6c6d05e2-e80c-477f-9eea-12f17d58d439',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.346437] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('99423afc-7fd3-4e3d-8a84-f190e0af048f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.349357] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.349787] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.349787] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.349787] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.349986] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.349986] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-765c6c90-a03d-493c-b8a2-6f3983207e5b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.775560] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e981dae-b2fb-4490-8e25-4c38eb726ea5 in Status: SUCCESS [ 768.775860] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e981dae-b2fb-4490-8e25-4c38eb726ea5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.776121] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e981dae-b2fb-4490-8e25-4c38eb726ea5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.776468] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e981dae-b2fb-4490-8e25-4c38eb726ea5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.776751] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.776954] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.777132] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.777386] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.777468] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.777597] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e981dae-b2fb-4490-8e25-4c38eb726ea5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.777763] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5e981dae-b2fb-4490-8e25-4c38eb726ea5',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.826506] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7d0941d4-57d8-45e9-9f2f-95128b8136e5',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.851945] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6c6d05e2-e80c-477f-9eea-12f17d58d439',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.852509] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('99423afc-7fd3-4e3d-8a84-f190e0af048f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.281591] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e981dae-b2fb-4490-8e25-4c38eb726ea5 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.281591] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e981dae-b2fb-4490-8e25-4c38eb726ea5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.281591] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e981dae-b2fb-4490-8e25-4c38eb726ea5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.281591] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e981dae-b2fb-4490-8e25-4c38eb726ea5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.281591] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.281591] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.281886] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.281886] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.281944] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.282012] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e981dae-b2fb-4490-8e25-4c38eb726ea5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.282131] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e981dae-b2fb-4490-8e25-4c38eb726ea5 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.282218] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e981dae-b2fb-4490-8e25-4c38eb726ea5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.283023] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e981dae-b2fb-4490-8e25-4c38eb726ea5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.283023] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e981dae-b2fb-4490-8e25-4c38eb726ea5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.283023] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.283023] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.283023] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.283023] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.283023] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.283023] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e981dae-b2fb-4490-8e25-4c38eb726ea5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.283351] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5e981dae-b2fb-4490-8e25-4c38eb726ea5',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.296038] env[65065]: INFO networking_nsxv3.common.synchronization [None req-2523fbc9-4bc0-4158-8728-22b7badac3e6 tempest-ImagesOneServerNegativeTestJSON-764093247 tempest-ImagesOneServerNegativeTestJSON-764093247-project-member] Enqueued Resource ID: 5b355547-610e-4518-94f2-82e8ddb16186 with Priority: HIGHEST for action security_group_rules [ 769.298310] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b355547-610e-4518-94f2-82e8ddb16186 with Priority: HIGHEST for action security_group_rules [ 769.298869] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5b355547-610e-4518-94f2-82e8ddb16186 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.299196] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5b355547-610e-4518-94f2-82e8ddb16186" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.301897] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5b355547-610e-4518-94f2-82e8ddb16186" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.301897] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5b355547-610e-4518-94f2-82e8ddb16186" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.301897] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5b355547-610e-4518-94f2-82e8ddb16186',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.328873] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.329063] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.329144] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.329375] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.329509] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.329559] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 is going to be created. [ 769.354851] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.359151] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.359151] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.359151] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.359151] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.359151] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c6d05e2-e80c-477f-9eea-12f17d58d439 is going to be updated. [ 769.359151] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.359151] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.359151] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.359151] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.359151] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.359151] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99423afc-7fd3-4e3d-8a84-f190e0af048f is going to be updated. [ 769.360437] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.360540] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.360604] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.360788] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.360964] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.376266] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 in Status: UNINITIALIZED for 2s [ 769.400927] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.401124] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.401219] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.401447] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.401596] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.403740] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.404219] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.404219] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.404219] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.404396] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.409254] env[65065]: INFO networking_nsxv3.common.synchronization [None req-2fea10bc-bb73-466b-9d15-4b77106c3350 tempest-ImagesOneServerNegativeTestJSON-764093247 tempest-ImagesOneServerNegativeTestJSON-764093247-project-member] Enqueued Resource ID: 5b355547-610e-4518-94f2-82e8ddb16186 with Priority: HIGHEST for action security_group_rules [ 769.410406] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b355547-610e-4518-94f2-82e8ddb16186 with Priority: HIGHEST for action security_group_rules [ 769.410949] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5b355547-610e-4518-94f2-82e8ddb16186 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.411144] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5b355547-610e-4518-94f2-82e8ddb16186" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.421109] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c6d05e2-e80c-477f-9eea-12f17d58d439 in Status: IN_PROGRESS for 2s [ 769.422040] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99423afc-7fd3-4e3d-8a84-f190e0af048f in Status: IN_PROGRESS for 2s [ 769.789515] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5e981dae-b2fb-4490-8e25-4c38eb726ea5: rpc.has_security_group_logging(os_id): False [ 769.793057] env[65065]: INFO networking_nsxv3.common.synchronization [req-c43fa00c-7db8-45ce-8f4d-9b57716918dc req-faa95e7b-18f8-4cf2-bdfb-9c1e47fee416 tempest-ServersTestBootFromVolume-1803684170 tempest-ServersTestBootFromVolume-1803684170-project-member] Enqueued Resource ID: adad9983-8e2e-4bac-8155-8a076b03abc3 with Priority: HIGHEST for action security_group_members [ 769.793057] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adad9983-8e2e-4bac-8155-8a076b03abc3 with Priority: HIGHEST for action security_group_members [ 769.793619] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-adad9983-8e2e-4bac-8155-8a076b03abc3 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.793619] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adad9983-8e2e-4bac-8155-8a076b03abc3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.793619] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adad9983-8e2e-4bac-8155-8a076b03abc3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.793946] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adad9983-8e2e-4bac-8155-8a076b03abc3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.794031] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.795060] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.795060] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.795060] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.795218] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.795249] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('adad9983-8e2e-4bac-8155-8a076b03abc3',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.827780] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.828256] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.828256] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.828256] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.828422] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.828422] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5b355547-610e-4518-94f2-82e8ddb16186 already deleted. [ 769.828482] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5b355547-610e-4518-94f2-82e8ddb16186" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.829721] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5b355547-610e-4518-94f2-82e8ddb16186" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.829956] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5b355547-610e-4518-94f2-82e8ddb16186" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.830058] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5b355547-610e-4518-94f2-82e8ddb16186',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.832048] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.832048] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.832048] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.832298] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.832298] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.832516] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.832685] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.832685] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.832833] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.832909] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.833170] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.833228] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.833402] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.833402] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.833475] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.833771] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.833771] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.833771] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.833904] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.834038] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.834038] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5e981dae-b2fb-4490-8e25-4c38eb726ea5 is going to be created. [ 769.945514] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.945762] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.945762] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.946111] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.946430] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.974234] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5e981dae-b2fb-4490-8e25-4c38eb726ea5 in Status: IN_PROGRESS for 2s [ 770.297914] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.298129] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.298129] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.298515] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.322468] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.322468] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.322468] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.322468] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.322468] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.322468] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.322468] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: adad9983-8e2e-4bac-8155-8a076b03abc3 is going to be updated. [ 770.354045] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.354206] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.354206] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.354385] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.354545] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.356331] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.356466] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.356535] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.356727] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.356888] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.356888] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5b355547-610e-4518-94f2-82e8ddb16186 already deleted. [ 770.356969] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5b355547-610e-4518-94f2-82e8ddb16186" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.366300] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: adad9983-8e2e-4bac-8155-8a076b03abc3 in Status: IN_PROGRESS for 2s [ 771.388533] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 in Status: SUCCESS [ 771.389252] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.389252] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.389252] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.389948] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.390243] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.390243] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.390600] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.390728] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.390937] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.391158] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7d0941d4-57d8-45e9-9f2f-95128b8136e5',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.432153] env[65065]: INFO networking_nsxv3.common.synchronization [req-329345b3-169d-4cef-b33c-9beebc7a819d req-5be59b08-cb35-422f-953d-485bc33d75df tempest-SecurityGroupsTestJSON-312946932 tempest-SecurityGroupsTestJSON-312946932-project-member] Enqueued Resource ID: 6c6d05e2-e80c-477f-9eea-12f17d58d439 with Priority: HIGHEST for action security_group_members [ 771.432153] env[65065]: INFO networking_nsxv3.common.synchronization [req-329345b3-169d-4cef-b33c-9beebc7a819d req-5be59b08-cb35-422f-953d-485bc33d75df tempest-SecurityGroupsTestJSON-312946932 tempest-SecurityGroupsTestJSON-312946932-project-member] Enqueued Resource ID: 99423afc-7fd3-4e3d-8a84-f190e0af048f with Priority: HIGHEST for action security_group_members [ 771.432541] env[65065]: INFO networking_nsxv3.common.synchronization [req-329345b3-169d-4cef-b33c-9beebc7a819d req-5be59b08-cb35-422f-953d-485bc33d75df tempest-SecurityGroupsTestJSON-312946932 tempest-SecurityGroupsTestJSON-312946932-project-member] Enqueued Resource ID: fe6a6a99-3736-4814-86e5-a69125ecc42e with Priority: HIGHEST for action security_group_members [ 771.433365] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c6d05e2-e80c-477f-9eea-12f17d58d439 with Priority: HIGHEST for action security_group_members [ 771.433991] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99423afc-7fd3-4e3d-8a84-f190e0af048f with Priority: HIGHEST for action security_group_members [ 771.433991] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe6a6a99-3736-4814-86e5-a69125ecc42e with Priority: HIGHEST for action security_group_members [ 771.434277] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c6d05e2-e80c-477f-9eea-12f17d58d439 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.434475] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c6d05e2-e80c-477f-9eea-12f17d58d439" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.434768] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-99423afc-7fd3-4e3d-8a84-f190e0af048f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.434926] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.435232] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe6a6a99-3736-4814-86e5-a69125ecc42e taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.435359] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe6a6a99-3736-4814-86e5-a69125ecc42e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.435525] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe6a6a99-3736-4814-86e5-a69125ecc42e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.435886] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe6a6a99-3736-4814-86e5-a69125ecc42e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.436854] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.436854] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.436854] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.436854] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.436854] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.436854] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fe6a6a99-3736-4814-86e5-a69125ecc42e',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.439262] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99423afc-7fd3-4e3d-8a84-f190e0af048f in Status: SUCCESS [ 771.439572] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.440844] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c6d05e2-e80c-477f-9eea-12f17d58d439 in Status: SUCCESS [ 771.440844] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c6d05e2-e80c-477f-9eea-12f17d58d439" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.441720] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.441999] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.442588] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.442588] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.442588] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.442817] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.442947] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.443118] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.443951] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('99423afc-7fd3-4e3d-8a84-f190e0af048f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.445224] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c6d05e2-e80c-477f-9eea-12f17d58d439" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.445631] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c6d05e2-e80c-477f-9eea-12f17d58d439" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.445631] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.445887] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.445988] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.446928] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.446928] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.446928] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c6d05e2-e80c-477f-9eea-12f17d58d439" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.446928] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6c6d05e2-e80c-477f-9eea-12f17d58d439',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.448428] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.448652] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.449020] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.449020] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.449309] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.449593] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.449593] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.449691] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('99423afc-7fd3-4e3d-8a84-f190e0af048f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.451470] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c6d05e2-e80c-477f-9eea-12f17d58d439" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.452133] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c6d05e2-e80c-477f-9eea-12f17d58d439" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.452795] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.452795] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.452795] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.452795] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.452795] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.453051] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6c6d05e2-e80c-477f-9eea-12f17d58d439',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.510391] env[65065]: INFO networking_nsxv3.common.synchronization [req-329345b3-169d-4cef-b33c-9beebc7a819d req-5be59b08-cb35-422f-953d-485bc33d75df tempest-SecurityGroupsTestJSON-312946932 tempest-SecurityGroupsTestJSON-312946932-project-member] Enqueued Resource ID: 6c6d05e2-e80c-477f-9eea-12f17d58d439 with Priority: HIGHEST for action security_group_rules [ 771.510739] env[65065]: INFO networking_nsxv3.common.synchronization [req-329345b3-169d-4cef-b33c-9beebc7a819d req-5be59b08-cb35-422f-953d-485bc33d75df tempest-SecurityGroupsTestJSON-312946932 tempest-SecurityGroupsTestJSON-312946932-project-member] Enqueued Resource ID: 6c6d05e2-e80c-477f-9eea-12f17d58d439 with Priority: HIGHEST for action security_group_members [ 771.511696] env[65065]: INFO networking_nsxv3.common.synchronization [req-329345b3-169d-4cef-b33c-9beebc7a819d req-5be59b08-cb35-422f-953d-485bc33d75df tempest-SecurityGroupsTestJSON-312946932 tempest-SecurityGroupsTestJSON-312946932-project-member] Enqueued Resource ID: 99423afc-7fd3-4e3d-8a84-f190e0af048f with Priority: HIGHEST for action security_group_rules [ 771.511995] env[65065]: INFO networking_nsxv3.common.synchronization [req-329345b3-169d-4cef-b33c-9beebc7a819d req-5be59b08-cb35-422f-953d-485bc33d75df tempest-SecurityGroupsTestJSON-312946932 tempest-SecurityGroupsTestJSON-312946932-project-member] Enqueued Resource ID: 99423afc-7fd3-4e3d-8a84-f190e0af048f with Priority: HIGHEST for action security_group_members [ 771.512222] env[65065]: INFO networking_nsxv3.common.synchronization [req-329345b3-169d-4cef-b33c-9beebc7a819d req-5be59b08-cb35-422f-953d-485bc33d75df tempest-SecurityGroupsTestJSON-312946932 tempest-SecurityGroupsTestJSON-312946932-project-member] Enqueued Resource ID: fe6a6a99-3736-4814-86e5-a69125ecc42e with Priority: HIGHEST for action security_group_rules [ 771.512432] env[65065]: INFO networking_nsxv3.common.synchronization [req-329345b3-169d-4cef-b33c-9beebc7a819d req-5be59b08-cb35-422f-953d-485bc33d75df tempest-SecurityGroupsTestJSON-312946932 tempest-SecurityGroupsTestJSON-312946932-project-member] Enqueued Resource ID: fe6a6a99-3736-4814-86e5-a69125ecc42e with Priority: HIGHEST for action security_group_members [ 771.512626] env[65065]: INFO networking_nsxv3.common.synchronization [req-329345b3-169d-4cef-b33c-9beebc7a819d req-5be59b08-cb35-422f-953d-485bc33d75df tempest-SecurityGroupsTestJSON-312946932 tempest-SecurityGroupsTestJSON-312946932-project-member] Enqueued Resource ID: ed9e82b0-1d53-462b-8d54-46f1aecfdc64 with Priority: HIGHEST for action port [ 771.514307] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c6d05e2-e80c-477f-9eea-12f17d58d439 with Priority: HIGHEST for action security_group_rules [ 771.514599] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99423afc-7fd3-4e3d-8a84-f190e0af048f with Priority: HIGHEST for action security_group_rules [ 771.514760] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe6a6a99-3736-4814-86e5-a69125ecc42e with Priority: HIGHEST for action security_group_members [ 771.514935] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed9e82b0-1d53-462b-8d54-46f1aecfdc64 with Priority: HIGHEST for action port [ 771.515225] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe6a6a99-3736-4814-86e5-a69125ecc42e with Priority: HIGHEST for action security_group_rules [ 771.515363] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c6d05e2-e80c-477f-9eea-12f17d58d439 with Priority: HIGHEST for action security_group_members [ 771.515482] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99423afc-7fd3-4e3d-8a84-f190e0af048f with Priority: HIGHEST for action security_group_members [ 771.515988] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6c6d05e2-e80c-477f-9eea-12f17d58d439 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.516153] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6c6d05e2-e80c-477f-9eea-12f17d58d439" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.516496] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-99423afc-7fd3-4e3d-8a84-f190e0af048f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.516569] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.516811] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe6a6a99-3736-4814-86e5-a69125ecc42e taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.516957] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe6a6a99-3736-4814-86e5-a69125ecc42e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.519970] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-ed9e82b0-1d53-462b-8d54-46f1aecfdc64 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.519970] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ed9e82b0-1d53-462b-8d54-46f1aecfdc64" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.519970] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ed9e82b0-1d53-462b-8d54-46f1aecfdc64" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.519970] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ed9e82b0-1d53-462b-8d54-46f1aecfdc64" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.519970] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ed9e82b0-1d53-462b-8d54-46f1aecfdc64',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.519970] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fe6a6a99-3736-4814-86e5-a69125ecc42e taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.519970] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fe6a6a99-3736-4814-86e5-a69125ecc42e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.519970] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fe6a6a99-3736-4814-86e5-a69125ecc42e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.520575] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fe6a6a99-3736-4814-86e5-a69125ecc42e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.520575] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fe6a6a99-3736-4814-86e5-a69125ecc42e',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.522062] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c6d05e2-e80c-477f-9eea-12f17d58d439 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.522184] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c6d05e2-e80c-477f-9eea-12f17d58d439" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.522396] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-99423afc-7fd3-4e3d-8a84-f190e0af048f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.522490] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.894946] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d0941d4-57d8-45e9-9f2f-95128b8136e5 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.894946] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.894946] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.895589] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.895670] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.895735] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.895794] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.895964] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.896087] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.896183] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.897621] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d0941d4-57d8-45e9-9f2f-95128b8136e5 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.897621] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.897621] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.897621] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.897621] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.897621] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.897621] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.897621] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.897621] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.897621] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.897621] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7d0941d4-57d8-45e9-9f2f-95128b8136e5',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.939746] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fe6a6a99-3736-4814-86e5-a69125ecc42e',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.950525] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-99423afc-7fd3-4e3d-8a84-f190e0af048f taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.950655] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.955428] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6c6d05e2-e80c-477f-9eea-12f17d58d439',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.956466] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('99423afc-7fd3-4e3d-8a84-f190e0af048f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.957629] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6c6d05e2-e80c-477f-9eea-12f17d58d439',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.014187] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5e981dae-b2fb-4490-8e25-4c38eb726ea5 in Status: SUCCESS [ 772.014479] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5e981dae-b2fb-4490-8e25-4c38eb726ea5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.023407] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe6a6a99-3736-4814-86e5-a69125ecc42e taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.023568] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe6a6a99-3736-4814-86e5-a69125ecc42e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.023722] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ed9e82b0-1d53-462b-8d54-46f1aecfdc64 with status ACTIVE [ 772.023891] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.024029] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.024113] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.024284] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.024371] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.024596] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.024699] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.024765] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.024918] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.024996] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.025192] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.025295] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.025351] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.026034] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.026034] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.026034] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ed9e82b0-1d53-462b-8d54-46f1aecfdc64 is going to be updated. [ 772.059226] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.059416] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.059470] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.059661] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.059807] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.059975] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ed9e82b0-1d53-462b-8d54-46f1aecfdc64" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.379346] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: adad9983-8e2e-4bac-8155-8a076b03abc3 in Status: SUCCESS [ 772.379346] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: adad9983-8e2e-4bac-8155-8a076b03abc3 deletion is rescheduled due to dependency. [ 772.379346] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adad9983-8e2e-4bac-8155-8a076b03abc3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.405741] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7d0941d4-57d8-45e9-9f2f-95128b8136e5: rpc.has_security_group_logging(os_id): False [ 772.428025] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.428431] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.428431] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.428532] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.428532] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.428752] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.428852] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.428915] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.429088] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.429165] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.429358] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.429474] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.429553] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.429718] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.429796] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.429971] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.430077] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.430139] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.430287] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.430351] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.430436] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 is going to be created. [ 772.442265] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fe6a6a99-3736-4814-86e5-a69125ecc42e',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.460177] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6c6d05e2-e80c-477f-9eea-12f17d58d439: rpc.has_security_group_logging(os_id): False [ 772.461561] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('99423afc-7fd3-4e3d-8a84-f190e0af048f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.462568] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6c6d05e2-e80c-477f-9eea-12f17d58d439',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.486951] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.487218] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.487297] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.487576] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.487748] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.488037] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.488179] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.488268] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.488585] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.488695] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.488843] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6c6d05e2-e80c-477f-9eea-12f17d58d439 is going to be created. [ 772.523035] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.523035] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.523255] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.523294] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.523581] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.533976] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 in Status: IN_PROGRESS for 2s [ 772.558653] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.559082] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.559082] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.559082] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.559525] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.576519] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6c6d05e2-e80c-477f-9eea-12f17d58d439 in Status: IN_PROGRESS for 2s [ 772.945637] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.945836] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.945888] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.946139] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.946225] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.946354] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fe6a6a99-3736-4814-86e5-a69125ecc42e is going to be created. [ 772.964526] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.965979] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.965979] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.965979] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.965979] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.965979] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c6d05e2-e80c-477f-9eea-12f17d58d439 is going to be updated. [ 772.967366] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.967366] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.967493] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.967574] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.967655] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.967742] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99423afc-7fd3-4e3d-8a84-f190e0af048f is going to be updated. [ 772.977568] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.977869] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.977869] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.977986] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.978288] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.990945] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fe6a6a99-3736-4814-86e5-a69125ecc42e in Status: UNINITIALIZED for 2s [ 773.010184] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.010487] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.010487] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.010726] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.010946] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.017110] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.017346] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.017420] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.017654] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.017907] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.032337] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c6d05e2-e80c-477f-9eea-12f17d58d439 in Status: IN_PROGRESS for 2s [ 773.032337] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99423afc-7fd3-4e3d-8a84-f190e0af048f in Status: IN_PROGRESS for 2s [ 773.903274] env[65065]: INFO networking_nsxv3.common.synchronization [req-9fd36f7f-cac4-4569-a415-166026d6ce7e req-9532593c-1c04-4e0e-aa9d-e37380124cbd tempest-ServerGroupTestJSON-266849952 tempest-ServerGroupTestJSON-266849952-project-member] Enqueued Resource ID: 64777a42-07f5-4e1e-a53c-afd2accca690 with Priority: HIGHEST for action security_group_members [ 773.903886] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64777a42-07f5-4e1e-a53c-afd2accca690 with Priority: HIGHEST for action security_group_members [ 773.904657] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-64777a42-07f5-4e1e-a53c-afd2accca690 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.904813] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64777a42-07f5-4e1e-a53c-afd2accca690" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.904913] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64777a42-07f5-4e1e-a53c-afd2accca690" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.905141] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64777a42-07f5-4e1e-a53c-afd2accca690" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.905337] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.905452] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.905515] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.905679] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.905789] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.905888] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('64777a42-07f5-4e1e-a53c-afd2accca690',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.407837] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.407837] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.408043] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.410507] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.410507] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.410507] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.410507] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.410507] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.410507] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.410507] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.410507] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64777a42-07f5-4e1e-a53c-afd2accca690 is going to be updated. [ 774.443236] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.443613] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.443815] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.444083] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.444245] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.455790] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64777a42-07f5-4e1e-a53c-afd2accca690 in Status: IN_PROGRESS for 2s [ 774.547921] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 in Status: SUCCESS [ 774.548171] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.591184] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6c6d05e2-e80c-477f-9eea-12f17d58d439 in Status: SUCCESS [ 774.591564] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6c6d05e2-e80c-477f-9eea-12f17d58d439" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.591786] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6c6d05e2-e80c-477f-9eea-12f17d58d439" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.592034] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6c6d05e2-e80c-477f-9eea-12f17d58d439" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.592127] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6c6d05e2-e80c-477f-9eea-12f17d58d439',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.717529] env[65065]: INFO networking_nsxv3.common.synchronization [req-d4827b2d-db7a-49fa-b9f0-d682bc8a0aa7 req-57a159b5-6509-4dd0-8f5c-e8211645f26b tempest-SecurityGroupsTestJSON-312946932 tempest-SecurityGroupsTestJSON-312946932-project-member] Enqueued Resource ID: fe6a6a99-3736-4814-86e5-a69125ecc42e with Priority: HIGHEST for action security_group_members [ 774.718140] env[65065]: INFO networking_nsxv3.common.synchronization [req-d4827b2d-db7a-49fa-b9f0-d682bc8a0aa7 req-57a159b5-6509-4dd0-8f5c-e8211645f26b tempest-SecurityGroupsTestJSON-312946932 tempest-SecurityGroupsTestJSON-312946932-project-member] Enqueued Resource ID: 6c6d05e2-e80c-477f-9eea-12f17d58d439 with Priority: HIGHEST for action security_group_members [ 774.718140] env[65065]: INFO networking_nsxv3.common.synchronization [req-d4827b2d-db7a-49fa-b9f0-d682bc8a0aa7 req-57a159b5-6509-4dd0-8f5c-e8211645f26b tempest-SecurityGroupsTestJSON-312946932 tempest-SecurityGroupsTestJSON-312946932-project-member] Enqueued Resource ID: 99423afc-7fd3-4e3d-8a84-f190e0af048f with Priority: HIGHEST for action security_group_members [ 774.720180] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe6a6a99-3736-4814-86e5-a69125ecc42e with Priority: HIGHEST for action security_group_members [ 774.720372] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c6d05e2-e80c-477f-9eea-12f17d58d439 with Priority: HIGHEST for action security_group_members [ 774.720518] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99423afc-7fd3-4e3d-8a84-f190e0af048f with Priority: HIGHEST for action security_group_members [ 774.720858] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe6a6a99-3736-4814-86e5-a69125ecc42e taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.720993] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe6a6a99-3736-4814-86e5-a69125ecc42e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.721257] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c6d05e2-e80c-477f-9eea-12f17d58d439 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.721373] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c6d05e2-e80c-477f-9eea-12f17d58d439" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.723084] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-99423afc-7fd3-4e3d-8a84-f190e0af048f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.723084] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.004678] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fe6a6a99-3736-4814-86e5-a69125ecc42e in Status: SUCCESS [ 775.005091] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe6a6a99-3736-4814-86e5-a69125ecc42e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.005755] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe6a6a99-3736-4814-86e5-a69125ecc42e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.005980] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe6a6a99-3736-4814-86e5-a69125ecc42e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.006389] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.006515] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.006612] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.007257] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.007257] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.007257] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fe6a6a99-3736-4814-86e5-a69125ecc42e',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.045612] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c6d05e2-e80c-477f-9eea-12f17d58d439 in Status: SUCCESS [ 775.046056] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c6d05e2-e80c-477f-9eea-12f17d58d439" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.046606] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c6d05e2-e80c-477f-9eea-12f17d58d439" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.046880] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c6d05e2-e80c-477f-9eea-12f17d58d439" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.048064] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.048064] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.048064] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.048064] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.048257] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.048519] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6c6d05e2-e80c-477f-9eea-12f17d58d439',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.050693] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99423afc-7fd3-4e3d-8a84-f190e0af048f in Status: SUCCESS [ 775.051043] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.051240] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.051495] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.052128] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.052128] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.052128] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.052128] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.052128] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.052319] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('99423afc-7fd3-4e3d-8a84-f190e0af048f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.097343] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c6d05e2-e80c-477f-9eea-12f17d58d439 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.097343] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c6d05e2-e80c-477f-9eea-12f17d58d439" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.511210] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.511210] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.511210] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.511210] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.511210] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.511210] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.511210] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.511210] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.511210] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.511210] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.511210] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fe6a6a99-3736-4814-86e5-a69125ecc42e is going to be deleted. [ 775.549727] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.549727] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.549727] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.549727] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.549727] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.549727] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe6a6a99-3736-4814-86e5-a69125ecc42e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.549727] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe6a6a99-3736-4814-86e5-a69125ecc42e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.550047] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe6a6a99-3736-4814-86e5-a69125ecc42e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.550047] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.550170] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.550231] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.550400] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.551023] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.551114] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fe6a6a99-3736-4814-86e5-a69125ecc42e',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.555305] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.555462] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.555510] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.555687] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.555771] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.555952] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.556086] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.556182] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.556429] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.556513] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.556600] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c6d05e2-e80c-477f-9eea-12f17d58d439 is going to be updated. [ 775.557643] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('99423afc-7fd3-4e3d-8a84-f190e0af048f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.601387] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.601387] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.601387] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.601387] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.601387] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.612917] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c6d05e2-e80c-477f-9eea-12f17d58d439 in Status: IN_PROGRESS for 2s [ 776.056628] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.057054] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.057054] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.057224] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.057280] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.057487] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.057593] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.057682] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.057791] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.057868] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.057949] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fe6a6a99-3736-4814-86e5-a69125ecc42e already deleted. [ 776.058040] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe6a6a99-3736-4814-86e5-a69125ecc42e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.058193] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fe6a6a99-3736-4814-86e5-a69125ecc42e',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.059124] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe6a6a99-3736-4814-86e5-a69125ecc42e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.059362] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe6a6a99-3736-4814-86e5-a69125ecc42e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.059467] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.059665] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.059665] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.059777] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.059835] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.059901] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fe6a6a99-3736-4814-86e5-a69125ecc42e',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.064974] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('99423afc-7fd3-4e3d-8a84-f190e0af048f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.472197] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64777a42-07f5-4e1e-a53c-afd2accca690 in Status: SUCCESS [ 776.472197] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64777a42-07f5-4e1e-a53c-afd2accca690 deletion is rescheduled due to dependency. [ 776.472197] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64777a42-07f5-4e1e-a53c-afd2accca690" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.562355] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fe6a6a99-3736-4814-86e5-a69125ecc42e',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.565039] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.565039] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.565039] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.565325] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.566054] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.566054] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.566054] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.566054] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.566054] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.566054] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.566054] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fe6a6a99-3736-4814-86e5-a69125ecc42e already deleted. [ 776.567805] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe6a6a99-3736-4814-86e5-a69125ecc42e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.567805] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.567805] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.567805] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.567805] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.567805] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.567805] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99423afc-7fd3-4e3d-8a84-f190e0af048f is going to be updated. [ 776.595454] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.595454] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.595894] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.598224] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.598224] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.607094] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99423afc-7fd3-4e3d-8a84-f190e0af048f in Status: IN_PROGRESS for 2s [ 776.788481] env[65065]: INFO networking_nsxv3.common.synchronization [req-59259988-9811-4691-aee6-d5a745b75bd2 req-2dc6ada3-ae47-4aba-9817-0fd71969d3b1 tempest-ImagesTestJSON-1714479415 tempest-ImagesTestJSON-1714479415-project-member] Enqueued Resource ID: e6d7baac-4bff-46b9-b88d-2dc982621c0f with Priority: HIGHEST for action security_group_members [ 776.788885] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6d7baac-4bff-46b9-b88d-2dc982621c0f with Priority: HIGHEST for action security_group_members [ 776.789423] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6d7baac-4bff-46b9-b88d-2dc982621c0f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.789536] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.789536] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.789826] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.790074] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.790232] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.790343] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.790558] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.790681] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.790782] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e6d7baac-4bff-46b9-b88d-2dc982621c0f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.064902] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fe6a6a99-3736-4814-86e5-a69125ecc42e: rpc.has_security_group_logging(os_id): False [ 777.091031] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.091031] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.091031] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.091031] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.091031] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.091031] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.091031] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.091031] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.091031] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.091031] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.091031] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fe6a6a99-3736-4814-86e5-a69125ecc42e is going to be created. [ 777.110415] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/fe6a6a99-3736-4814-86e5-a69125ecc42e], does not exist path=[/infra/domains/default/groups/fe6a6a99-3736-4814-86e5-a69125ecc42e]."\n}' [ 777.114209] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fe6a6a99-3736-4814-86e5-a69125ecc42e failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/fe6a6a99-3736-4814-86e5-a69125ecc42e [ 777.114209] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 777.157878] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.157878] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.157878] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.157878] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.159741] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.166300] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.166300] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.166300] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.166300] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.166300] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.166300] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.166300] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.166300] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.166300] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.166300] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.166300] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fe6a6a99-3736-4814-86e5-a69125ecc42e is going to be created. [ 777.197527] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/fe6a6a99-3736-4814-86e5-a69125ecc42e], does not exist path=[/infra/domains/default/groups/fe6a6a99-3736-4814-86e5-a69125ecc42e]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/fe6a6a99-3736-4814-86e5-a69125ecc42e [ 777.197527] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fe6a6a99-3736-4814-86e5-a69125ecc42e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.197527] env[65065]: Traceback (most recent call last): [ 777.197527] env[65065]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 777.197527] env[65065]: return func(*args, **kwargs) [ 777.197527] env[65065]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 777.197527] env[65065]: res.raise_for_status() [ 777.197527] env[65065]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 777.197527] env[65065]: raise HTTPError(http_error_msg, response=self) [ 777.197527] env[65065]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/fe6a6a99-3736-4814-86e5-a69125ecc42e [ 777.197527] env[65065]: During handling of the above exception, another exception occurred: [ 777.197527] env[65065]: Traceback (most recent call last): [ 777.197527] env[65065]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 777.197527] env[65065]: listener.cb(fileno) [ 777.197527] env[65065]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 777.197527] env[65065]: result = function(*args, **kwargs) [ 777.197527] env[65065]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 777.197527] env[65065]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 777.197527] env[65065]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 777.197527] env[65065]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 777.197527] env[65065]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 777.197527] env[65065]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 777.197527] env[65065]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 777.197527] env[65065]: res.raise_for_status() [ 777.197527] env[65065]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 777.197527] env[65065]: raise HTTPError(http_error_msg, response=self) [ 777.197527] env[65065]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/fe6a6a99-3736-4814-86e5-a69125ecc42e [ 777.197527] env[65065]: Removing descriptor: 16 [ 777.278674] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock network-582 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.278927] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "network-582" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.279102] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "network-582" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.279488] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "network-582" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.279801] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.280019] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.280201] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.280506] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.280814] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.281100] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 777.281283] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 777.281439] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 777.281611] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 777.281799] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 777.281969] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 777.282859] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 777.292992] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.293149] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.293220] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.293420] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.307213] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 777.307316] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 777.307403] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 777.307616] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "network-582" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.307874] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock port-cfc76b3f-814c-4ad7-93a6-5b4dcad94e3c taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.308047] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "port-cfc76b3f-814c-4ad7-93a6-5b4dcad94e3c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.308158] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "port-cfc76b3f-814c-4ad7-93a6-5b4dcad94e3c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.308547] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "port-cfc76b3f-814c-4ad7-93a6-5b4dcad94e3c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.308685] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cfc76b3f-814c-4ad7-93a6-5b4dcad94e3c',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.329728] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.330066] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.330357] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.330357] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.330538] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.330628] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.330718] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6d7baac-4bff-46b9-b88d-2dc982621c0f is going to be updated. [ 777.384340] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.384340] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.384340] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.384793] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.384954] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.413781] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6d7baac-4bff-46b9-b88d-2dc982621c0f in Status: IN_PROGRESS for 2s [ 777.625152] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c6d05e2-e80c-477f-9eea-12f17d58d439 in Status: SUCCESS [ 777.625358] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c6d05e2-e80c-477f-9eea-12f17d58d439 deletion is rescheduled due to dependency. [ 777.625465] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c6d05e2-e80c-477f-9eea-12f17d58d439" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.625650] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c6d05e2-e80c-477f-9eea-12f17d58d439" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.625864] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c6d05e2-e80c-477f-9eea-12f17d58d439" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.626059] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.626174] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.626236] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.626429] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.626502] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.626597] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6c6d05e2-e80c-477f-9eea-12f17d58d439',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.811463] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.812463] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.812463] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.812463] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.812824] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.812824] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Segment Port cfc76b3f-814c-4ad7-93a6-5b4dcad94e3c not found, creating... [ 777.813203] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.813203] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.813524] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.813524] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.813617] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.813890] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.814050] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.814164] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.814383] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.814624] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.814624] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Resource: SegmentPort with ID: cfc76b3f-814c-4ad7-93a6-5b4dcad94e3c is going to be created. [ 777.841317] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.841621] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.841701] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.841905] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.842142] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.842477] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "port-cfc76b3f-814c-4ad7-93a6-5b4dcad94e3c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.926923] env[65065]: INFO networking_nsxv3.common.synchronization [None req-dfa31bc8-22bd-4e8f-8b35-9ce247c98d26 None None] Enqueued Resource ID: 57615a1f-3641-418e-84e6-c70d89276560 with Priority: HIGHEST for action port [ 777.927917] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57615a1f-3641-418e-84e6-c70d89276560 with Priority: HIGHEST for action port [ 777.927917] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-57615a1f-3641-418e-84e6-c70d89276560 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.927917] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-57615a1f-3641-418e-84e6-c70d89276560" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.928179] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-57615a1f-3641-418e-84e6-c70d89276560" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.928435] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-57615a1f-3641-418e-84e6-c70d89276560" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.928998] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('57615a1f-3641-418e-84e6-c70d89276560',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.129085] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.129487] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.129487] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.129721] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.151658] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.151938] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.152071] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.152136] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.152345] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.152424] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.152513] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c6d05e2-e80c-477f-9eea-12f17d58d439 is going to be updated. [ 778.180847] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.181123] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.181248] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.181582] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.181835] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.197794] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c6d05e2-e80c-477f-9eea-12f17d58d439 in Status: IN_PROGRESS for 2s [ 778.431856] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 57615a1f-3641-418e-84e6-c70d89276560 [ 778.432343] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.432670] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.432823] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.433085] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.433237] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.433319] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:57615a1f-3641-418e-84e6-c70d89276560 already deleted. [ 778.433412] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-57615a1f-3641-418e-84e6-c70d89276560" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.597020] env[65065]: INFO networking_nsxv3.common.synchronization [req-59259988-9811-4691-aee6-d5a745b75bd2 req-b020baba-3d5f-4be9-8770-863d97c07f80 service nova] Enqueued Resource ID: e6d7baac-4bff-46b9-b88d-2dc982621c0f with Priority: HIGHEST for action security_group_rules [ 778.597020] env[65065]: INFO networking_nsxv3.common.synchronization [req-59259988-9811-4691-aee6-d5a745b75bd2 req-b020baba-3d5f-4be9-8770-863d97c07f80 service nova] Enqueued Resource ID: e6d7baac-4bff-46b9-b88d-2dc982621c0f with Priority: HIGHEST for action security_group_members [ 778.597020] env[65065]: INFO networking_nsxv3.common.synchronization [req-59259988-9811-4691-aee6-d5a745b75bd2 req-b020baba-3d5f-4be9-8770-863d97c07f80 service nova] Enqueued Resource ID: cfc76b3f-814c-4ad7-93a6-5b4dcad94e3c with Priority: HIGHEST for action port [ 778.597020] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6d7baac-4bff-46b9-b88d-2dc982621c0f with Priority: HIGHEST for action security_group_rules [ 778.597020] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6d7baac-4bff-46b9-b88d-2dc982621c0f with Priority: HIGHEST for action security_group_members [ 778.597020] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cfc76b3f-814c-4ad7-93a6-5b4dcad94e3c with Priority: HIGHEST for action port [ 778.597020] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e6d7baac-4bff-46b9-b88d-2dc982621c0f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.597451] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.597451] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.597451] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.597451] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e6d7baac-4bff-46b9-b88d-2dc982621c0f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.598308] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6d7baac-4bff-46b9-b88d-2dc982621c0f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.598868] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.598868] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-cfc76b3f-814c-4ad7-93a6-5b4dcad94e3c taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.598868] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cfc76b3f-814c-4ad7-93a6-5b4dcad94e3c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.598868] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cfc76b3f-814c-4ad7-93a6-5b4dcad94e3c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.599155] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cfc76b3f-814c-4ad7-93a6-5b4dcad94e3c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.599155] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cfc76b3f-814c-4ad7-93a6-5b4dcad94e3c',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.618598] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99423afc-7fd3-4e3d-8a84-f190e0af048f in Status: SUCCESS [ 778.620044] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.620044] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.620272] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.620416] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.620538] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.620628] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.620939] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.621057] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.621144] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.621306] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-99423afc-7fd3-4e3d-8a84-f190e0af048f taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.621381] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.621439] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.621574] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.621745] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.621834] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.621891] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.622032] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.622103] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.622177] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.622258] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('99423afc-7fd3-4e3d-8a84-f190e0af048f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.623562] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.623607] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.623738] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.623830] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.623890] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.624036] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.624113] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.624199] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('99423afc-7fd3-4e3d-8a84-f190e0af048f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.969831] env[65065]: INFO networking_nsxv3.common.synchronization [req-70741686-0d48-47dc-bee7-22ff2d65d20f req-36cb1bce-dffb-48c4-ae2d-e2ccb4c99e0b tempest-ServerDiagnosticsNegativeTest-2091454356 tempest-ServerDiagnosticsNegativeTest-2091454356-project-member] Enqueued Resource ID: 5e981dae-b2fb-4490-8e25-4c38eb726ea5 with Priority: HIGHEST for action security_group_members [ 778.970249] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e981dae-b2fb-4490-8e25-4c38eb726ea5 with Priority: HIGHEST for action security_group_members [ 778.970666] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e981dae-b2fb-4490-8e25-4c38eb726ea5 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.970790] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e981dae-b2fb-4490-8e25-4c38eb726ea5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.970790] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e981dae-b2fb-4490-8e25-4c38eb726ea5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.972023] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e981dae-b2fb-4490-8e25-4c38eb726ea5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.972023] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.972023] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.972023] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.972023] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.972023] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.972023] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e981dae-b2fb-4490-8e25-4c38eb726ea5',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.100962] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6d7baac-4bff-46b9-b88d-2dc982621c0f taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.100962] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.101334] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cfc76b3f-814c-4ad7-93a6-5b4dcad94e3c with status ACTIVE [ 779.101334] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.101410] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.101505] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.102170] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.102170] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.102170] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.102170] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.102170] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.102498] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.102498] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.102633] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.102717] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.102784] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.102925] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.102998] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.103114] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cfc76b3f-814c-4ad7-93a6-5b4dcad94e3c is going to be updated. [ 779.125430] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.125581] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.125661] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.125879] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.126054] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.126232] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cfc76b3f-814c-4ad7-93a6-5b4dcad94e3c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.126475] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 99423afc-7fd3-4e3d-8a84-f190e0af048f: rpc.has_security_group_logging(os_id): False [ 779.127444] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('99423afc-7fd3-4e3d-8a84-f190e0af048f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.148205] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.148751] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.148751] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.148751] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.170530] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.170530] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.170530] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.170530] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.170530] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.170981] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.171365] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.172439] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.172439] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.172439] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.172439] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.172439] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.172439] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.172439] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.172439] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.172439] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.172800] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 99423afc-7fd3-4e3d-8a84-f190e0af048f is going to be updated. [ 779.260067] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.260067] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.260067] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.260067] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.260385] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.289012] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 99423afc-7fd3-4e3d-8a84-f190e0af048f in Status: IN_PROGRESS for 2s [ 779.426479] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6d7baac-4bff-46b9-b88d-2dc982621c0f in Status: SUCCESS [ 779.426479] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6d7baac-4bff-46b9-b88d-2dc982621c0f deletion is rescheduled due to dependency. [ 779.426479] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.426479] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.426479] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.426479] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.426479] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.426479] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.426753] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.426753] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.426907] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e6d7baac-4bff-46b9-b88d-2dc982621c0f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.474019] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.474833] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.474940] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.475291] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.502750] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.502750] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.502750] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.502995] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.502995] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.503061] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.503156] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e981dae-b2fb-4490-8e25-4c38eb726ea5 is going to be updated. [ 779.543604] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.544558] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.544558] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.545505] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.545505] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.554748] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e981dae-b2fb-4490-8e25-4c38eb726ea5 in Status: IN_PROGRESS for 2s [ 779.630548] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('99423afc-7fd3-4e3d-8a84-f190e0af048f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.932406] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e6d7baac-4bff-46b9-b88d-2dc982621c0f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.132233] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.132396] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.132486] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.132704] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.132874] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.132976] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99423afc-7fd3-4e3d-8a84-f190e0af048f is going to be updated. [ 780.149609] env[65065]: INFO networking_nsxv3.common.synchronization [None req-06116e25-70f7-4581-a1d3-f1ff502510d9 None None] Enqueued Resource ID: 0e740f4a-dc77-46a1-8630-0d509d17e01d with Priority: HIGHEST for action port [ 780.150108] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e740f4a-dc77-46a1-8630-0d509d17e01d with Priority: HIGHEST for action port [ 780.150409] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-0e740f4a-dc77-46a1-8630-0d509d17e01d taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.150532] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0e740f4a-dc77-46a1-8630-0d509d17e01d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.150585] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0e740f4a-dc77-46a1-8630-0d509d17e01d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.150899] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0e740f4a-dc77-46a1-8630-0d509d17e01d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.150985] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0e740f4a-dc77-46a1-8630-0d509d17e01d',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.162137] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.162286] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.162354] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.162579] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.162743] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.172737] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99423afc-7fd3-4e3d-8a84-f190e0af048f in Status: IN_PROGRESS for 2s [ 780.206257] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c6d05e2-e80c-477f-9eea-12f17d58d439 in Status: SUCCESS [ 780.206425] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c6d05e2-e80c-477f-9eea-12f17d58d439 deletion is rescheduled due to dependency. [ 780.206567] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c6d05e2-e80c-477f-9eea-12f17d58d439" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.206772] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c6d05e2-e80c-477f-9eea-12f17d58d439" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.206992] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c6d05e2-e80c-477f-9eea-12f17d58d439" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.207221] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.207340] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.207405] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.207561] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.207642] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.207726] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c6d05e2-e80c-477f-9eea-12f17d58d439" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.207816] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6c6d05e2-e80c-477f-9eea-12f17d58d439',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.434974] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e6d7baac-4bff-46b9-b88d-2dc982621c0f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.655515] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0e740f4a-dc77-46a1-8630-0d509d17e01d [ 780.655515] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.655515] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.655515] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.655515] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.655515] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.655515] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0e740f4a-dc77-46a1-8630-0d509d17e01d already deleted. [ 780.655515] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0e740f4a-dc77-46a1-8630-0d509d17e01d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.710512] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6c6d05e2-e80c-477f-9eea-12f17d58d439',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.937545] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.937701] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.938509] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.938509] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.938509] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.938509] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6d7baac-4bff-46b9-b88d-2dc982621c0f is going to be updated. [ 780.971179] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.971338] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.971338] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.972359] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.972359] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.982762] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6d7baac-4bff-46b9-b88d-2dc982621c0f in Status: IN_PROGRESS for 2s [ 781.213763] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6c6d05e2-e80c-477f-9eea-12f17d58d439: rpc.has_security_group_logging(os_id): False [ 781.231897] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.232136] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.232212] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.232427] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.232516] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.232770] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.232833] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.232938] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.233346] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.233433] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.233525] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6c6d05e2-e80c-477f-9eea-12f17d58d439 is going to be updated. [ 781.305859] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.306126] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.306265] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.306574] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.306767] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.314040] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 99423afc-7fd3-4e3d-8a84-f190e0af048f in Status: SUCCESS [ 781.314220] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.314280] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.314519] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.314610] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('99423afc-7fd3-4e3d-8a84-f190e0af048f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.322622] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6c6d05e2-e80c-477f-9eea-12f17d58d439 in Status: IN_PROGRESS for 2s [ 781.565481] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e981dae-b2fb-4490-8e25-4c38eb726ea5 in Status: SUCCESS [ 781.565481] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e981dae-b2fb-4490-8e25-4c38eb726ea5 deletion is rescheduled due to dependency. [ 781.565481] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e981dae-b2fb-4490-8e25-4c38eb726ea5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.816992] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-99423afc-7fd3-4e3d-8a84-f190e0af048f taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.817138] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.903924] env[65065]: INFO networking_nsxv3.common.synchronization [req-12577e32-9730-4752-995c-cdbff3a81bbf req-2d71f75d-1d22-40b9-a5e6-7e5a3790f947 tempest-DeleteServersTestJSON-1316666736 tempest-DeleteServersTestJSON-1316666736-project-member] Enqueued Resource ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 with Priority: HIGHEST for action security_group_members [ 781.904510] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 with Priority: HIGHEST for action security_group_members [ 781.904810] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d0941d4-57d8-45e9-9f2f-95128b8136e5 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.905295] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.905295] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.905295] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.905465] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.905465] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.905553] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.905664] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.905746] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.905836] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d0941d4-57d8-45e9-9f2f-95128b8136e5',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.182946] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99423afc-7fd3-4e3d-8a84-f190e0af048f in Status: SUCCESS [ 782.183132] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.183816] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.183950] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.184177] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.184293] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.184357] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.184508] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.184590] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.184677] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.184766] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('99423afc-7fd3-4e3d-8a84-f190e0af048f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.408348] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.408671] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.408671] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.408841] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.430586] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.430764] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.431044] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.431044] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.431541] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.431541] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.431541] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 is going to be updated. [ 782.461437] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.461580] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.461639] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.461952] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.461989] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.472961] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 in Status: IN_PROGRESS for 2s [ 782.687459] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-99423afc-7fd3-4e3d-8a84-f190e0af048f taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.687624] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.687698] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.687924] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.688107] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.688207] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.688271] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.688460] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.688546] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.688635] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.688784] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-99423afc-7fd3-4e3d-8a84-f190e0af048f taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.688876] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.688935] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.689088] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.689241] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.689334] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.689407] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.689600] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.689674] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.689757] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.689847] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('99423afc-7fd3-4e3d-8a84-f190e0af048f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.992949] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6d7baac-4bff-46b9-b88d-2dc982621c0f in Status: SUCCESS [ 782.993196] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.993361] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.993590] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.993774] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.993889] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.993955] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.994128] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.994205] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.994289] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.994379] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e6d7baac-4bff-46b9-b88d-2dc982621c0f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.193404] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 99423afc-7fd3-4e3d-8a84-f190e0af048f: rpc.has_security_group_logging(os_id): False [ 783.219765] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.219928] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.219984] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.220274] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.220322] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.220489] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.220668] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.220668] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.220794] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.220862] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.221067] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.221164] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.221260] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.221440] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.221440] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.221630] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.221733] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.221795] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.221938] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.222154] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.222261] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 99423afc-7fd3-4e3d-8a84-f190e0af048f is going to be updated. [ 783.325901] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.326059] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.326137] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.328137] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.328137] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.349607] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6c6d05e2-e80c-477f-9eea-12f17d58d439 in Status: SUCCESS [ 783.349607] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6c6d05e2-e80c-477f-9eea-12f17d58d439" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.357955] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 99423afc-7fd3-4e3d-8a84-f190e0af048f in Status: IN_PROGRESS for 2s [ 783.497373] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6d7baac-4bff-46b9-b88d-2dc982621c0f taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.498208] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.501029] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.501029] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.501029] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.501029] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.501029] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.501029] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.501029] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.501029] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.501029] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6d7baac-4bff-46b9-b88d-2dc982621c0f taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.501029] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.501029] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.501029] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.501029] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.501029] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.501029] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.501029] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.501029] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.501029] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.501918] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e6d7baac-4bff-46b9-b88d-2dc982621c0f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.006602] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e6d7baac-4bff-46b9-b88d-2dc982621c0f: rpc.has_security_group_logging(os_id): False [ 784.028141] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.028354] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.028401] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.028635] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.029122] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.029271] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.029451] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.029451] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.029618] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.029703] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.029879] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.029987] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.030046] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.030179] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.030250] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.030689] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.030689] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.030689] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.030859] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.031044] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.031044] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e6d7baac-4bff-46b9-b88d-2dc982621c0f is going to be updated. [ 784.125207] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.125396] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.125437] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.125693] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.125784] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.146432] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e6d7baac-4bff-46b9-b88d-2dc982621c0f in Status: IN_PROGRESS for 2s [ 784.483197] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 in Status: SUCCESS [ 784.483410] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 deletion is rescheduled due to dependency. [ 784.483533] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.380074] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 99423afc-7fd3-4e3d-8a84-f190e0af048f in Status: SUCCESS [ 785.380606] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.534260] env[65065]: INFO networking_nsxv3.common.synchronization [None req-4691e834-f206-4d5f-85ce-23e5cf356d16 None None] Enqueued Resource ID: f1e5ea01-14da-4b62-b0aa-7384f8ab1528 with Priority: HIGHEST for action port [ 785.534905] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1e5ea01-14da-4b62-b0aa-7384f8ab1528 with Priority: HIGHEST for action port [ 785.535237] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-f1e5ea01-14da-4b62-b0aa-7384f8ab1528 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.535348] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f1e5ea01-14da-4b62-b0aa-7384f8ab1528" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.535418] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f1e5ea01-14da-4b62-b0aa-7384f8ab1528" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.535680] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f1e5ea01-14da-4b62-b0aa-7384f8ab1528" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.535764] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f1e5ea01-14da-4b62-b0aa-7384f8ab1528',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.037867] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f1e5ea01-14da-4b62-b0aa-7384f8ab1528 [ 786.038146] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.038352] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.038466] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.039501] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.039501] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.039501] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f1e5ea01-14da-4b62-b0aa-7384f8ab1528 already deleted. [ 786.039501] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f1e5ea01-14da-4b62-b0aa-7384f8ab1528" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.159709] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e6d7baac-4bff-46b9-b88d-2dc982621c0f in Status: SUCCESS [ 786.159709] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.514223] env[65065]: INFO networking_nsxv3.common.synchronization [None req-ce89f150-d2d7-49fc-9279-44331b6d9b2d None None] Enqueued Resource ID: 725d7a10-a535-4e3b-b8ab-7573d3890cdc with Priority: HIGHEST for action port [ 786.514781] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 725d7a10-a535-4e3b-b8ab-7573d3890cdc with Priority: HIGHEST for action port [ 786.514851] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-725d7a10-a535-4e3b-b8ab-7573d3890cdc taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.515034] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-725d7a10-a535-4e3b-b8ab-7573d3890cdc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.515137] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-725d7a10-a535-4e3b-b8ab-7573d3890cdc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.515744] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-725d7a10-a535-4e3b-b8ab-7573d3890cdc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.515744] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('725d7a10-a535-4e3b-b8ab-7573d3890cdc',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.018158] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 725d7a10-a535-4e3b-b8ab-7573d3890cdc [ 787.019573] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.019573] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.022184] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.022184] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.022184] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.022184] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:725d7a10-a535-4e3b-b8ab-7573d3890cdc already deleted. [ 787.022184] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-725d7a10-a535-4e3b-b8ab-7573d3890cdc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.911208] env[65065]: INFO networking_nsxv3.common.synchronization [req-b9060a32-76fe-45cd-8ddf-c10f099c15c1 req-705a9654-7df7-4661-9d2d-4a496521fa80 tempest-ServersTestManualDisk-1006050063 tempest-ServersTestManualDisk-1006050063-project-member] Enqueued Resource ID: f9002bdd-0416-4909-9ac7-2b8cecd66558 with Priority: HIGHEST for action security_group_members [ 787.911208] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9002bdd-0416-4909-9ac7-2b8cecd66558 with Priority: HIGHEST for action security_group_members [ 787.913942] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9002bdd-0416-4909-9ac7-2b8cecd66558 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.913942] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9002bdd-0416-4909-9ac7-2b8cecd66558" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.913942] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9002bdd-0416-4909-9ac7-2b8cecd66558" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.918798] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9002bdd-0416-4909-9ac7-2b8cecd66558" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.918798] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.918798] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.918798] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.918798] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.918798] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.918798] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f9002bdd-0416-4909-9ac7-2b8cecd66558',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.231851] env[65065]: INFO networking_nsxv3.common.synchronization [None req-7a500780-d690-442b-bd67-f8fa81dfcd4e None None] Enqueued Resource ID: 1fed3f1f-4100-48a7-b824-44113f1215ba with Priority: HIGHEST for action port [ 788.232077] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1fed3f1f-4100-48a7-b824-44113f1215ba with Priority: HIGHEST for action port [ 788.233793] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-1fed3f1f-4100-48a7-b824-44113f1215ba taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.233793] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1fed3f1f-4100-48a7-b824-44113f1215ba" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.233793] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1fed3f1f-4100-48a7-b824-44113f1215ba" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.233793] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1fed3f1f-4100-48a7-b824-44113f1215ba" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.233793] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1fed3f1f-4100-48a7-b824-44113f1215ba',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.345107] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock network-342 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.345107] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "network-342" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.345107] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "network-342" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.345497] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "network-342" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.345602] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.345830] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.346705] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.348799] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.348984] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.349223] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 788.349329] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 788.350300] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 788.350300] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 788.350300] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 788.350300] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 788.350300] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 788.373765] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 788.373765] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 788.373765] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 788.374257] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "network-342" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.374257] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock port-0d06f359-9b69-4c8c-bb1e-0d8ff49330bf taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.374460] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "port-0d06f359-9b69-4c8c-bb1e-0d8ff49330bf" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.374519] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "port-0d06f359-9b69-4c8c-bb1e-0d8ff49330bf" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.374876] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "port-0d06f359-9b69-4c8c-bb1e-0d8ff49330bf" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.375071] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0d06f359-9b69-4c8c-bb1e-0d8ff49330bf',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.420025] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.420025] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.420336] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.420336] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.420474] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.420945] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.420945] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.420945] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.420945] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.421354] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.421354] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f9002bdd-0416-4909-9ac7-2b8cecd66558 already deleted. [ 788.421354] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9002bdd-0416-4909-9ac7-2b8cecd66558" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.737034] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1fed3f1f-4100-48a7-b824-44113f1215ba [ 788.737129] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.737265] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.737335] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.737587] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.737997] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.738157] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1fed3f1f-4100-48a7-b824-44113f1215ba already deleted. [ 788.738267] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1fed3f1f-4100-48a7-b824-44113f1215ba" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.882457] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.882457] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.882457] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.882457] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.882457] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.882457] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Segment Port 0d06f359-9b69-4c8c-bb1e-0d8ff49330bf not found, creating... [ 788.882457] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.882457] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.882457] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.882457] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.882457] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.883074] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.883074] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.883668] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.884173] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.884524] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.884861] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Resource: SegmentPort with ID: 0d06f359-9b69-4c8c-bb1e-0d8ff49330bf is going to be created. [ 788.908130] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.908130] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.908130] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.908130] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.908130] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.908130] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "port-0d06f359-9b69-4c8c-bb1e-0d8ff49330bf" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.620231] env[65065]: INFO networking_nsxv3.common.synchronization [req-b9060a32-76fe-45cd-8ddf-c10f099c15c1 req-10c9f2fc-e476-480b-855c-bacc7cb9a69a service nova] Enqueued Resource ID: f9002bdd-0416-4909-9ac7-2b8cecd66558 with Priority: HIGHEST for action security_group_rules [ 789.620582] env[65065]: INFO networking_nsxv3.common.synchronization [req-b9060a32-76fe-45cd-8ddf-c10f099c15c1 req-10c9f2fc-e476-480b-855c-bacc7cb9a69a service nova] Enqueued Resource ID: f9002bdd-0416-4909-9ac7-2b8cecd66558 with Priority: HIGHEST for action security_group_members [ 789.620733] env[65065]: INFO networking_nsxv3.common.synchronization [req-b9060a32-76fe-45cd-8ddf-c10f099c15c1 req-10c9f2fc-e476-480b-855c-bacc7cb9a69a service nova] Enqueued Resource ID: 0d06f359-9b69-4c8c-bb1e-0d8ff49330bf with Priority: HIGHEST for action port [ 789.621919] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9002bdd-0416-4909-9ac7-2b8cecd66558 with Priority: HIGHEST for action security_group_rules [ 789.622211] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9002bdd-0416-4909-9ac7-2b8cecd66558 with Priority: HIGHEST for action security_group_members [ 789.622633] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d06f359-9b69-4c8c-bb1e-0d8ff49330bf with Priority: HIGHEST for action port [ 789.623434] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f9002bdd-0416-4909-9ac7-2b8cecd66558 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.623881] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f9002bdd-0416-4909-9ac7-2b8cecd66558" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.624040] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f9002bdd-0416-4909-9ac7-2b8cecd66558" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.624381] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f9002bdd-0416-4909-9ac7-2b8cecd66558" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.624561] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f9002bdd-0416-4909-9ac7-2b8cecd66558',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.626359] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9002bdd-0416-4909-9ac7-2b8cecd66558 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.626567] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9002bdd-0416-4909-9ac7-2b8cecd66558" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.626695] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9002bdd-0416-4909-9ac7-2b8cecd66558" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.626963] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9002bdd-0416-4909-9ac7-2b8cecd66558" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.627251] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.627428] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.627719] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.628028] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.628205] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.628413] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f9002bdd-0416-4909-9ac7-2b8cecd66558',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.629670] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-0d06f359-9b69-4c8c-bb1e-0d8ff49330bf taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.630038] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0d06f359-9b69-4c8c-bb1e-0d8ff49330bf" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.630191] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0d06f359-9b69-4c8c-bb1e-0d8ff49330bf" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.630448] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0d06f359-9b69-4c8c-bb1e-0d8ff49330bf" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.630596] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0d06f359-9b69-4c8c-bb1e-0d8ff49330bf',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.697670] env[65065]: INFO networking_nsxv3.common.synchronization [None req-96fce9fe-4e16-47ce-b5a0-27da7648c364 None None] Enqueued Resource ID: 3aac94bc-77bf-41a2-8bee-cdc81641c4e0 with Priority: HIGHEST for action port [ 789.697670] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3aac94bc-77bf-41a2-8bee-cdc81641c4e0 with Priority: HIGHEST for action port [ 789.697670] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-3aac94bc-77bf-41a2-8bee-cdc81641c4e0 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.697670] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3aac94bc-77bf-41a2-8bee-cdc81641c4e0" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.700118] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3aac94bc-77bf-41a2-8bee-cdc81641c4e0" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.700118] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3aac94bc-77bf-41a2-8bee-cdc81641c4e0" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.700118] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3aac94bc-77bf-41a2-8bee-cdc81641c4e0',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.133249] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f9002bdd-0416-4909-9ac7-2b8cecd66558',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.134269] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9002bdd-0416-4909-9ac7-2b8cecd66558 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.134389] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9002bdd-0416-4909-9ac7-2b8cecd66558" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.134766] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0d06f359-9b69-4c8c-bb1e-0d8ff49330bf with status ACTIVE [ 790.134938] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.135066] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.135150] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.135368] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.135512] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.135689] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.135772] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.135839] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.136010] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.136114] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.136296] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.136381] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.136445] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.136588] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.136661] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.136742] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0d06f359-9b69-4c8c-bb1e-0d8ff49330bf is going to be updated. [ 790.158322] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.158734] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.158734] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.158872] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.158932] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.159312] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0d06f359-9b69-4c8c-bb1e-0d8ff49330bf" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.205130] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3aac94bc-77bf-41a2-8bee-cdc81641c4e0 [ 790.206138] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.206138] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.206138] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.206138] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.206138] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.206138] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3aac94bc-77bf-41a2-8bee-cdc81641c4e0 already deleted. [ 790.206138] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3aac94bc-77bf-41a2-8bee-cdc81641c4e0" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.636214] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f9002bdd-0416-4909-9ac7-2b8cecd66558',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.139316] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.139850] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.141285] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.141708] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.141947] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.142162] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f9002bdd-0416-4909-9ac7-2b8cecd66558 is going to be created. [ 791.171203] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.171203] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.171203] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.171203] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.171203] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.181473] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9002bdd-0416-4909-9ac7-2b8cecd66558 in Status: UNINITIALIZED for 2s [ 792.489744] env[65065]: INFO networking_nsxv3.common.synchronization [req-c100177a-8c5a-488a-a82e-74e20fa480de req-55dc7fb1-8727-456c-b7a1-a39548490e32 tempest-ListImageFiltersTestJSON-354392293 tempest-ListImageFiltersTestJSON-354392293-project-member] Enqueued Resource ID: 1cb445c1-075d-4f89-884f-a4bbf84030d0 with Priority: HIGHEST for action security_group_members [ 792.491628] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cb445c1-075d-4f89-884f-a4bbf84030d0 with Priority: HIGHEST for action security_group_members [ 792.492925] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-1cb445c1-075d-4f89-884f-a4bbf84030d0 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.493082] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1cb445c1-075d-4f89-884f-a4bbf84030d0" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.493156] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1cb445c1-075d-4f89-884f-a4bbf84030d0" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.493373] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1cb445c1-075d-4f89-884f-a4bbf84030d0" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.493660] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.494075] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.494215] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.494523] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.494758] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.494812] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1cb445c1-075d-4f89-884f-a4bbf84030d0',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.998440] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.998440] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.998440] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.998837] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.020605] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.021744] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.021744] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.021744] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.021744] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.021744] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.021744] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1cb445c1-075d-4f89-884f-a4bbf84030d0 is going to be updated. [ 793.052373] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.052606] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.052606] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.052873] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.053045] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.063550] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1cb445c1-075d-4f89-884f-a4bbf84030d0 in Status: IN_PROGRESS for 2s [ 793.192593] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9002bdd-0416-4909-9ac7-2b8cecd66558 in Status: SUCCESS [ 793.193476] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9002bdd-0416-4909-9ac7-2b8cecd66558" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.193476] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9002bdd-0416-4909-9ac7-2b8cecd66558" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.193476] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9002bdd-0416-4909-9ac7-2b8cecd66558" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.193476] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.193476] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.193726] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.193781] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.193869] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.193951] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9002bdd-0416-4909-9ac7-2b8cecd66558" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.194052] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f9002bdd-0416-4909-9ac7-2b8cecd66558',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.625043] env[65065]: INFO networking_nsxv3.common.synchronization [req-c623a798-1a6d-47af-afca-7ca09757bdcd req-84cab7f2-db64-417e-b8bc-d01cedc447ea tempest-FloatingIPsAssociationTestJSON-1239844979 tempest-FloatingIPsAssociationTestJSON-1239844979-project-member] Enqueued Resource ID: a7006bfc-4bfa-49da-a51e-6cc26b8098c3 with Priority: HIGHEST for action security_group_members [ 793.625419] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7006bfc-4bfa-49da-a51e-6cc26b8098c3 with Priority: HIGHEST for action security_group_members [ 793.625692] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7006bfc-4bfa-49da-a51e-6cc26b8098c3 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.625820] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7006bfc-4bfa-49da-a51e-6cc26b8098c3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.625888] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7006bfc-4bfa-49da-a51e-6cc26b8098c3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.626098] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7006bfc-4bfa-49da-a51e-6cc26b8098c3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.626251] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.626398] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.626479] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.626612] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.626702] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.626801] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a7006bfc-4bfa-49da-a51e-6cc26b8098c3',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.696056] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f9002bdd-0416-4909-9ac7-2b8cecd66558',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.975366] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock network-80 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.976015] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "network-80" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.976015] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "network-80" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.976015] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "network-80" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.976239] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.976335] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.976411] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.976641] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.976727] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.976912] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 793.977020] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 793.977331] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 793.977331] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 793.977331] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 793.977539] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 793.978152] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 793.998366] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 793.998583] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 793.998726] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 793.998896] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "network-80" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.999211] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock port-aaa2a381-bac3-440f-86fe-1065442d7610 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.999378] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "port-aaa2a381-bac3-440f-86fe-1065442d7610" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.999491] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "port-aaa2a381-bac3-440f-86fe-1065442d7610" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.999916] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "port-aaa2a381-bac3-440f-86fe-1065442d7610" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.000059] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aaa2a381-bac3-440f-86fe-1065442d7610',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.128924] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a7006bfc-4bfa-49da-a51e-6cc26b8098c3',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.198796] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f9002bdd-0416-4909-9ac7-2b8cecd66558: rpc.has_security_group_logging(os_id): False [ 794.216940] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.217230] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.217230] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.217397] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.217473] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.217808] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.217922] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.218410] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.218410] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.218410] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.218669] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f9002bdd-0416-4909-9ac7-2b8cecd66558 is going to be created. [ 794.282396] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.282556] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.282631] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.282852] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.283047] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.295106] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f9002bdd-0416-4909-9ac7-2b8cecd66558 in Status: IN_PROGRESS for 2s [ 794.504515] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.505038] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.505038] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.505219] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.505355] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.505500] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Segment Port aaa2a381-bac3-440f-86fe-1065442d7610 not found, creating... [ 794.505760] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.505910] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.506040] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.506297] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.506480] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.506787] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.506935] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.507064] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.507267] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.507399] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.507528] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Resource: SegmentPort with ID: aaa2a381-bac3-440f-86fe-1065442d7610 is going to be created. [ 794.532924] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.532924] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.532924] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.533253] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.534342] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.534342] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "port-aaa2a381-bac3-440f-86fe-1065442d7610" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.631541] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a7006bfc-4bfa-49da-a51e-6cc26b8098c3',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.074513] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1cb445c1-075d-4f89-884f-a4bbf84030d0 in Status: SUCCESS [ 795.074992] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1cb445c1-075d-4f89-884f-a4bbf84030d0 deletion is rescheduled due to dependency. [ 795.075475] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1cb445c1-075d-4f89-884f-a4bbf84030d0" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.134496] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.134814] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.134910] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.135192] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.135352] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.135475] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a7006bfc-4bfa-49da-a51e-6cc26b8098c3 is going to be updated. [ 795.172524] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.172653] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.172758] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.172962] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.173169] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.185320] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7006bfc-4bfa-49da-a51e-6cc26b8098c3 in Status: IN_PROGRESS for 2s [ 795.297062] env[65065]: INFO networking_nsxv3.common.synchronization [req-c623a798-1a6d-47af-afca-7ca09757bdcd req-fd2da283-787b-4d4e-9a37-c93dd87a7afb service nova] Enqueued Resource ID: a7006bfc-4bfa-49da-a51e-6cc26b8098c3 with Priority: HIGHEST for action security_group_rules [ 795.297264] env[65065]: INFO networking_nsxv3.common.synchronization [req-c623a798-1a6d-47af-afca-7ca09757bdcd req-fd2da283-787b-4d4e-9a37-c93dd87a7afb service nova] Enqueued Resource ID: a7006bfc-4bfa-49da-a51e-6cc26b8098c3 with Priority: HIGHEST for action security_group_members [ 795.297502] env[65065]: INFO networking_nsxv3.common.synchronization [req-c623a798-1a6d-47af-afca-7ca09757bdcd req-fd2da283-787b-4d4e-9a37-c93dd87a7afb service nova] Enqueued Resource ID: aaa2a381-bac3-440f-86fe-1065442d7610 with Priority: HIGHEST for action port [ 795.298281] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7006bfc-4bfa-49da-a51e-6cc26b8098c3 with Priority: HIGHEST for action security_group_rules [ 795.298524] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7006bfc-4bfa-49da-a51e-6cc26b8098c3 with Priority: HIGHEST for action security_group_members [ 795.298878] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aaa2a381-bac3-440f-86fe-1065442d7610 with Priority: HIGHEST for action port [ 795.299048] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a7006bfc-4bfa-49da-a51e-6cc26b8098c3 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.299917] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a7006bfc-4bfa-49da-a51e-6cc26b8098c3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.299917] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a7006bfc-4bfa-49da-a51e-6cc26b8098c3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.299917] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a7006bfc-4bfa-49da-a51e-6cc26b8098c3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.299917] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a7006bfc-4bfa-49da-a51e-6cc26b8098c3',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.301603] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7006bfc-4bfa-49da-a51e-6cc26b8098c3 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.301603] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7006bfc-4bfa-49da-a51e-6cc26b8098c3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.302763] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-aaa2a381-bac3-440f-86fe-1065442d7610 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.302763] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aaa2a381-bac3-440f-86fe-1065442d7610" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.302763] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aaa2a381-bac3-440f-86fe-1065442d7610" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.302991] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aaa2a381-bac3-440f-86fe-1065442d7610" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.303098] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aaa2a381-bac3-440f-86fe-1065442d7610',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.802562] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7006bfc-4bfa-49da-a51e-6cc26b8098c3 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.802913] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7006bfc-4bfa-49da-a51e-6cc26b8098c3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.808316] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port aaa2a381-bac3-440f-86fe-1065442d7610 with status ACTIVE [ 795.808608] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.808772] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.808890] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.809191] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.809340] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.809567] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.809680] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.809744] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.809972] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.810093] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.810336] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.810539] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.810656] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.810845] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.810951] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.811086] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: aaa2a381-bac3-440f-86fe-1065442d7610 is going to be updated. [ 795.834022] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.834192] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.834282] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.834523] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.834680] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.834857] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aaa2a381-bac3-440f-86fe-1065442d7610" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.307787] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f9002bdd-0416-4909-9ac7-2b8cecd66558 in Status: SUCCESS [ 796.307787] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f9002bdd-0416-4909-9ac7-2b8cecd66558" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.000419] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.001100] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.001100] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.001100] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.001100] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.201012] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7006bfc-4bfa-49da-a51e-6cc26b8098c3 in Status: SUCCESS [ 797.201012] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7006bfc-4bfa-49da-a51e-6cc26b8098c3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.202151] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7006bfc-4bfa-49da-a51e-6cc26b8098c3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.202151] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7006bfc-4bfa-49da-a51e-6cc26b8098c3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.202151] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.202151] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.202151] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.202151] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.202151] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.202151] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a7006bfc-4bfa-49da-a51e-6cc26b8098c3',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.378539] env[65065]: INFO networking_nsxv3.common.synchronization [req-73e6e19c-8860-49d7-9851-6c614b563a02 req-f3a6e51f-e43e-444c-9f30-2243490d5cce tempest-AttachInterfacesTestJSON-1590270829 tempest-AttachInterfacesTestJSON-1590270829-project-member] Enqueued Resource ID: 7299f16a-2557-464b-9f29-2b3b8469fc29 with Priority: HIGHEST for action security_group_members [ 797.379107] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7299f16a-2557-464b-9f29-2b3b8469fc29 with Priority: HIGHEST for action security_group_members [ 797.380025] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-7299f16a-2557-464b-9f29-2b3b8469fc29 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.380025] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7299f16a-2557-464b-9f29-2b3b8469fc29" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.380025] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7299f16a-2557-464b-9f29-2b3b8469fc29" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.380025] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7299f16a-2557-464b-9f29-2b3b8469fc29" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.380025] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.380320] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.380320] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.380448] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.380490] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.380583] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7299f16a-2557-464b-9f29-2b3b8469fc29',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.503583] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.705474] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a7006bfc-4bfa-49da-a51e-6cc26b8098c3',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.755669] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock network-688 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.755853] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "network-688" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.755968] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "network-688" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.756310] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "network-688" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.756593] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.756762] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.756909] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.757178] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.757325] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.757528] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 797.757638] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 797.757735] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 797.757838] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 797.757941] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 797.758052] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 797.758179] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 797.791735] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 797.791908] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Cache value generated in 0.034 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 797.792053] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 797.792226] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "network-688" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.792556] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock port-0812c012-471e-474c-8851-011b35aba3a5 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.792737] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "port-0812c012-471e-474c-8851-011b35aba3a5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.792872] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "port-0812c012-471e-474c-8851-011b35aba3a5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.793216] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "port-0812c012-471e-474c-8851-011b35aba3a5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.793364] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0812c012-471e-474c-8851-011b35aba3a5',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.884254] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.884514] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.884650] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.884988] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.885166] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.885472] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.885630] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.885737] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.885981] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.886126] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.886267] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7299f16a-2557-464b-9f29-2b3b8469fc29 already deleted. [ 797.886398] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7299f16a-2557-464b-9f29-2b3b8469fc29" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.005554] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.207071] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a7006bfc-4bfa-49da-a51e-6cc26b8098c3',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.295989] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.296289] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.296473] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.296657] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.296900] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.297140] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Segment Port 0812c012-471e-474c-8851-011b35aba3a5 not found, creating... [ 798.297408] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.297571] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.297689] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.297903] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.298043] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.298319] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.298608] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.298784] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.298995] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.299519] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.299767] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Resource: SegmentPort with ID: 0812c012-471e-474c-8851-011b35aba3a5 is going to be created. [ 798.320581] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.320826] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.320976] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.321291] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.321520] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.321745] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "port-0812c012-471e-474c-8851-011b35aba3a5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.507559] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 798.507685] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 798.709609] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.709921] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.710029] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.710293] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.710356] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.710419] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a7006bfc-4bfa-49da-a51e-6cc26b8098c3 is going to be updated. [ 798.741308] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.741537] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.741537] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.741702] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.741799] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.751222] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7006bfc-4bfa-49da-a51e-6cc26b8098c3 in Status: IN_PROGRESS for 2s [ 799.072278] env[65065]: INFO networking_nsxv3.common.synchronization [req-73e6e19c-8860-49d7-9851-6c614b563a02 req-2db57da7-ae7c-4571-a41c-8454ee8a75a5 service nova] Enqueued Resource ID: 7299f16a-2557-464b-9f29-2b3b8469fc29 with Priority: HIGHEST for action security_group_rules [ 799.072568] env[65065]: INFO networking_nsxv3.common.synchronization [req-73e6e19c-8860-49d7-9851-6c614b563a02 req-2db57da7-ae7c-4571-a41c-8454ee8a75a5 service nova] Enqueued Resource ID: 7299f16a-2557-464b-9f29-2b3b8469fc29 with Priority: HIGHEST for action security_group_members [ 799.072648] env[65065]: INFO networking_nsxv3.common.synchronization [req-73e6e19c-8860-49d7-9851-6c614b563a02 req-2db57da7-ae7c-4571-a41c-8454ee8a75a5 service nova] Enqueued Resource ID: 0812c012-471e-474c-8851-011b35aba3a5 with Priority: HIGHEST for action port [ 799.073219] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7299f16a-2557-464b-9f29-2b3b8469fc29 with Priority: HIGHEST for action security_group_rules [ 799.073360] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7299f16a-2557-464b-9f29-2b3b8469fc29 with Priority: HIGHEST for action security_group_members [ 799.073458] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0812c012-471e-474c-8851-011b35aba3a5 with Priority: HIGHEST for action port [ 799.073732] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7299f16a-2557-464b-9f29-2b3b8469fc29 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.073852] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7299f16a-2557-464b-9f29-2b3b8469fc29" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.073921] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7299f16a-2557-464b-9f29-2b3b8469fc29" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.074147] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7299f16a-2557-464b-9f29-2b3b8469fc29" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.074203] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7299f16a-2557-464b-9f29-2b3b8469fc29',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.075181] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-7299f16a-2557-464b-9f29-2b3b8469fc29 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.075295] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7299f16a-2557-464b-9f29-2b3b8469fc29" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.078541] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7299f16a-2557-464b-9f29-2b3b8469fc29" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.078541] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7299f16a-2557-464b-9f29-2b3b8469fc29" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.078541] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.078541] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.078541] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.078541] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.078541] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.079138] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7299f16a-2557-464b-9f29-2b3b8469fc29',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.080097] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-0812c012-471e-474c-8851-011b35aba3a5 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.080097] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0812c012-471e-474c-8851-011b35aba3a5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.080097] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0812c012-471e-474c-8851-011b35aba3a5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.080097] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0812c012-471e-474c-8851-011b35aba3a5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.080097] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0812c012-471e-474c-8851-011b35aba3a5',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.401732] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.402118] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.402372] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.402696] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.417132] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 799.418303] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.419583] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 799.451623] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.451623] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.451623] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.451623] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.460446] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.461263] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 799.461263] env[65065]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65065) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 799.461263] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 799.504271] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.504480] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.504788] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.504861] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.505701] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.505862] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 799.573862] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.574087] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.574087] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.574315] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.574557] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.574840] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 799.581854] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-7299f16a-2557-464b-9f29-2b3b8469fc29 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.582153] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7299f16a-2557-464b-9f29-2b3b8469fc29" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.582153] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7299f16a-2557-464b-9f29-2b3b8469fc29',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.583233] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0812c012-471e-474c-8851-011b35aba3a5 with status ACTIVE [ 799.583418] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.583526] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.583587] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.583784] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.583881] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.584078] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.584178] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.584236] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.584410] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.584490] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.584809] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.584928] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.584988] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.585148] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.585220] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.585301] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0812c012-471e-474c-8851-011b35aba3a5 is going to be updated. [ 799.612146] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.612339] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.612397] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.612650] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.612824] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.614373] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0812c012-471e-474c-8851-011b35aba3a5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.661826] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.661826] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.661826] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.662080] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.662080] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.662625] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:36. [ 799.662625] env[65065]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'f9002bdd-0416-4909-9ac7-2b8cecd66558', 'b95b4f27-41f6-4a01-a1aa-aa16348ad807', '16e2d0aa-9161-41ee-99b8-486218dfa51d', '83648dc4-e98f-47b1-b96c-2c0a05ebae74', 'c587345b-51c8-42f7-8a0c-052027c4b18c', 'e6d7baac-4bff-46b9-b88d-2dc982621c0f', '36775ca6-e5c8-4c23-bad8-a30192db7f3f', 'ed4053b7-493c-48f8-b82e-b002cbcc3a61', 'd38273aa-e7d2-4aea-bcb1-2f5ae899e71f', 'ffd44fac-c762-408c-862b-ccea34e00947', '39a21d13-3ed6-45f8-bfde-b892e16df2e1', '8a13ba64-a593-4798-b668-78791377ba50', '64777a42-07f5-4e1e-a53c-afd2accca690', '1cb445c1-075d-4f89-884f-a4bbf84030d0', 'c16acdbe-d600-40de-b3d9-384201f1e513', '960b9480-1a74-45ed-ba3b-4c9311dd370c', '45d9fbda-3bbf-490e-af96-b968c92e95ba', '45ff18a7-4a73-49de-af36-6c1d70b047f6', '620bfc73-f8be-4924-840f-8cc06371ccef', '5e981dae-b2fb-4490-8e25-4c38eb726ea5', 'f3805be6-3069-4624-897e-f4bf1dc6cd31', '9ed22036-e9a4-4639-89b9-c743ca686b09', 'c264aab4-0245-4fdf-8152-a3476b7dd553', 'a7006bfc-4bfa-49da-a51e-6cc26b8098c3', '9576b45f-b344-47bd-8f8b-9df4c3725ddb', 'adad9983-8e2e-4bac-8155-8a076b03abc3', '7d0941d4-57d8-45e9-9f2f-95128b8136e5', 'cc04914d-716e-49e1-8a77-946f904f69bb', '36b0a7bf-c185-47f8-9c6c-88ed66cc1f56', '5501386c-6d40-4911-b095-561660dd038b', '6c6d05e2-e80c-477f-9eea-12f17d58d439', 'afe348a4-4bdc-4830-8b52-3584e5dee837', 'e4ff6072-a232-4ebe-b049-2085dcef5991', '4a714159-17dd-4324-93b8-81c81e256b0e', '99423afc-7fd3-4e3d-8a84-f190e0af048f', '4473193a-198b-4342-a9ef-a1966ddd9441'} {{(pid=65065) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 799.662625] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 799.696352] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.696550] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.696635] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.697135] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.697135] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.697135] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 799.697375] env[65065]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65065) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 799.697375] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 799.780253] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.780495] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.780495] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.780694] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.781442] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.781656] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 799.781799] env[65065]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65065) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 799.781799] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 799.781929] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 799.781929] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/36 resources of Type:Security Group Rules [ 799.782035] env[65065]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f9002bdd-0416-4909-9ac7-2b8cecd66558 with Priority: HIGH for action security_group_rules [ 799.782087] env[65065]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b95b4f27-41f6-4a01-a1aa-aa16348ad807 with Priority: HIGH for action security_group_rules [ 799.782164] env[65065]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 16e2d0aa-9161-41ee-99b8-486218dfa51d with Priority: HIGH for action security_group_rules [ 799.782232] env[65065]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 83648dc4-e98f-47b1-b96c-2c0a05ebae74 with Priority: HIGH for action security_group_rules [ 799.782458] env[65065]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c587345b-51c8-42f7-8a0c-052027c4b18c with Priority: HIGH for action security_group_rules [ 799.782458] env[65065]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e6d7baac-4bff-46b9-b88d-2dc982621c0f with Priority: HIGH for action security_group_rules [ 799.782458] env[65065]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 36775ca6-e5c8-4c23-bad8-a30192db7f3f with Priority: HIGH for action security_group_rules [ 799.782585] env[65065]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ed4053b7-493c-48f8-b82e-b002cbcc3a61 with Priority: HIGH for action security_group_rules [ 799.782585] env[65065]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d38273aa-e7d2-4aea-bcb1-2f5ae899e71f with Priority: HIGH for action security_group_rules [ 799.782641] env[65065]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ffd44fac-c762-408c-862b-ccea34e00947 with Priority: HIGH for action security_group_rules [ 799.782689] env[65065]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 39a21d13-3ed6-45f8-bfde-b892e16df2e1 with Priority: HIGH for action security_group_rules [ 799.782764] env[65065]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8a13ba64-a593-4798-b668-78791377ba50 with Priority: HIGH for action security_group_rules [ 799.782865] env[65065]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 64777a42-07f5-4e1e-a53c-afd2accca690 with Priority: HIGH for action security_group_rules [ 799.782940] env[65065]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1cb445c1-075d-4f89-884f-a4bbf84030d0 with Priority: HIGH for action security_group_rules [ 799.783100] env[65065]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c16acdbe-d600-40de-b3d9-384201f1e513 with Priority: HIGH for action security_group_rules [ 799.783100] env[65065]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 960b9480-1a74-45ed-ba3b-4c9311dd370c with Priority: HIGH for action security_group_rules [ 799.783194] env[65065]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 45d9fbda-3bbf-490e-af96-b968c92e95ba with Priority: HIGH for action security_group_rules [ 799.783194] env[65065]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 45ff18a7-4a73-49de-af36-6c1d70b047f6 with Priority: HIGH for action security_group_rules [ 799.783266] env[65065]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 620bfc73-f8be-4924-840f-8cc06371ccef with Priority: HIGH for action security_group_rules [ 799.783303] env[65065]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5e981dae-b2fb-4490-8e25-4c38eb726ea5 with Priority: HIGH for action security_group_rules [ 799.783400] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.883331] env[65065]: INFO networking_nsxv3.common.synchronization [req-84130373-2cb9-492f-a487-23b2c8884d32 req-be59b30b-0ada-4150-acf9-a6993213299e tempest-ServersWithSpecificFlavorTestJSON-1007896152 tempest-ServersWithSpecificFlavorTestJSON-1007896152-project-member] Enqueued Resource ID: 9576b45f-b344-47bd-8f8b-9df4c3725ddb with Priority: HIGHEST for action security_group_members [ 799.883974] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9576b45f-b344-47bd-8f8b-9df4c3725ddb with Priority: HIGHEST for action security_group_members [ 799.884152] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9002bdd-0416-4909-9ac7-2b8cecd66558 with Priority: HIGH for action security_group_rules [ 799.884262] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16e2d0aa-9161-41ee-99b8-486218dfa51d with Priority: HIGH for action security_group_rules [ 799.884361] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 36775ca6-e5c8-4c23-bad8-a30192db7f3f with Priority: HIGH for action security_group_rules [ 799.884459] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c16acdbe-d600-40de-b3d9-384201f1e513 with Priority: HIGH for action security_group_rules [ 799.884554] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e981dae-b2fb-4490-8e25-4c38eb726ea5 with Priority: HIGH for action security_group_rules [ 799.884645] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 620bfc73-f8be-4924-840f-8cc06371ccef with Priority: HIGH for action security_group_rules [ 799.884740] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45ff18a7-4a73-49de-af36-6c1d70b047f6 with Priority: HIGH for action security_group_rules [ 799.884829] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45d9fbda-3bbf-490e-af96-b968c92e95ba with Priority: HIGH for action security_group_rules [ 799.884918] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cb445c1-075d-4f89-884f-a4bbf84030d0 with Priority: HIGH for action security_group_rules [ 799.885017] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 960b9480-1a74-45ed-ba3b-4c9311dd370c with Priority: HIGH for action security_group_rules [ 799.885111] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64777a42-07f5-4e1e-a53c-afd2accca690 with Priority: HIGH for action security_group_rules [ 799.885199] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a13ba64-a593-4798-b668-78791377ba50 with Priority: HIGH for action security_group_rules [ 799.885286] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39a21d13-3ed6-45f8-bfde-b892e16df2e1 with Priority: HIGH for action security_group_rules [ 799.885369] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ffd44fac-c762-408c-862b-ccea34e00947 with Priority: HIGH for action security_group_rules [ 799.885452] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d38273aa-e7d2-4aea-bcb1-2f5ae899e71f with Priority: HIGH for action security_group_rules [ 799.885537] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6d7baac-4bff-46b9-b88d-2dc982621c0f with Priority: HIGH for action security_group_rules [ 799.885620] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed4053b7-493c-48f8-b82e-b002cbcc3a61 with Priority: HIGH for action security_group_rules [ 799.885708] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c587345b-51c8-42f7-8a0c-052027c4b18c with Priority: HIGH for action security_group_rules [ 799.885784] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b95b4f27-41f6-4a01-a1aa-aa16348ad807 with Priority: HIGH for action security_group_rules [ 799.885871] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83648dc4-e98f-47b1-b96c-2c0a05ebae74 with Priority: HIGH for action security_group_rules [ 799.886203] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-9576b45f-b344-47bd-8f8b-9df4c3725ddb taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.886327] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9576b45f-b344-47bd-8f8b-9df4c3725ddb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.886410] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9576b45f-b344-47bd-8f8b-9df4c3725ddb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.886596] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9576b45f-b344-47bd-8f8b-9df4c3725ddb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.886744] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.886864] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.886933] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.887288] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.887288] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.887288] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9576b45f-b344-47bd-8f8b-9df4c3725ddb',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.888240] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f9002bdd-0416-4909-9ac7-2b8cecd66558 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.888369] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f9002bdd-0416-4909-9ac7-2b8cecd66558" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.888435] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f9002bdd-0416-4909-9ac7-2b8cecd66558" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.888654] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f9002bdd-0416-4909-9ac7-2b8cecd66558" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.888728] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f9002bdd-0416-4909-9ac7-2b8cecd66558',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.889881] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-16e2d0aa-9161-41ee-99b8-486218dfa51d taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.889998] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-16e2d0aa-9161-41ee-99b8-486218dfa51d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.890075] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-16e2d0aa-9161-41ee-99b8-486218dfa51d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.890234] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-16e2d0aa-9161-41ee-99b8-486218dfa51d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.890345] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('16e2d0aa-9161-41ee-99b8-486218dfa51d',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.891075] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-36775ca6-e5c8-4c23-bad8-a30192db7f3f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.891192] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-36775ca6-e5c8-4c23-bad8-a30192db7f3f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.891256] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-36775ca6-e5c8-4c23-bad8-a30192db7f3f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.891425] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-36775ca6-e5c8-4c23-bad8-a30192db7f3f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.891514] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('36775ca6-e5c8-4c23-bad8-a30192db7f3f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.892708] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c16acdbe-d600-40de-b3d9-384201f1e513 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.892828] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c16acdbe-d600-40de-b3d9-384201f1e513" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.893284] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c16acdbe-d600-40de-b3d9-384201f1e513" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.893468] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c16acdbe-d600-40de-b3d9-384201f1e513" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.893581] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c16acdbe-d600-40de-b3d9-384201f1e513',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.897388] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5e981dae-b2fb-4490-8e25-4c38eb726ea5 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.897530] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5e981dae-b2fb-4490-8e25-4c38eb726ea5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.897600] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5e981dae-b2fb-4490-8e25-4c38eb726ea5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.897801] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5e981dae-b2fb-4490-8e25-4c38eb726ea5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.897940] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5e981dae-b2fb-4490-8e25-4c38eb726ea5',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.899967] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-620bfc73-f8be-4924-840f-8cc06371ccef taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.899967] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-620bfc73-f8be-4924-840f-8cc06371ccef" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.899967] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-620bfc73-f8be-4924-840f-8cc06371ccef" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.900151] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-620bfc73-f8be-4924-840f-8cc06371ccef" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.900151] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('620bfc73-f8be-4924-840f-8cc06371ccef',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.901013] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-45ff18a7-4a73-49de-af36-6c1d70b047f6 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.901121] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-45ff18a7-4a73-49de-af36-6c1d70b047f6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.901180] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-45ff18a7-4a73-49de-af36-6c1d70b047f6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.901504] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-45ff18a7-4a73-49de-af36-6c1d70b047f6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.901504] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('45ff18a7-4a73-49de-af36-6c1d70b047f6',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.902330] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-45d9fbda-3bbf-490e-af96-b968c92e95ba taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.902879] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-45d9fbda-3bbf-490e-af96-b968c92e95ba" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.902879] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-45d9fbda-3bbf-490e-af96-b968c92e95ba" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.902879] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-45d9fbda-3bbf-490e-af96-b968c92e95ba" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.902879] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('45d9fbda-3bbf-490e-af96-b968c92e95ba',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.905910] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1cb445c1-075d-4f89-884f-a4bbf84030d0 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.906589] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1cb445c1-075d-4f89-884f-a4bbf84030d0" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.906681] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1cb445c1-075d-4f89-884f-a4bbf84030d0" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.906785] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1cb445c1-075d-4f89-884f-a4bbf84030d0" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.906862] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1cb445c1-075d-4f89-884f-a4bbf84030d0',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.907582] env[65065]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20 [ 799.908152] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-960b9480-1a74-45ed-ba3b-4c9311dd370c taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.908282] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-960b9480-1a74-45ed-ba3b-4c9311dd370c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.908346] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-960b9480-1a74-45ed-ba3b-4c9311dd370c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.908477] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-960b9480-1a74-45ed-ba3b-4c9311dd370c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.908596] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('960b9480-1a74-45ed-ba3b-4c9311dd370c',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.909415] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-64777a42-07f5-4e1e-a53c-afd2accca690 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.909535] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-64777a42-07f5-4e1e-a53c-afd2accca690" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.909593] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-64777a42-07f5-4e1e-a53c-afd2accca690" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.909913] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-64777a42-07f5-4e1e-a53c-afd2accca690" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.910016] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('64777a42-07f5-4e1e-a53c-afd2accca690',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.911149] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8a13ba64-a593-4798-b668-78791377ba50 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.911275] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8a13ba64-a593-4798-b668-78791377ba50" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.911327] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8a13ba64-a593-4798-b668-78791377ba50" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.911466] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8a13ba64-a593-4798-b668-78791377ba50" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.911536] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8a13ba64-a593-4798-b668-78791377ba50',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.912373] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-39a21d13-3ed6-45f8-bfde-b892e16df2e1 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.912490] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-39a21d13-3ed6-45f8-bfde-b892e16df2e1" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.912548] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-39a21d13-3ed6-45f8-bfde-b892e16df2e1" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.912862] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-39a21d13-3ed6-45f8-bfde-b892e16df2e1" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.912935] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('39a21d13-3ed6-45f8-bfde-b892e16df2e1',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.913744] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ffd44fac-c762-408c-862b-ccea34e00947 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.914462] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.914462] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.914462] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.914462] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ffd44fac-c762-408c-862b-ccea34e00947',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.915101] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d38273aa-e7d2-4aea-bcb1-2f5ae899e71f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.915214] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d38273aa-e7d2-4aea-bcb1-2f5ae899e71f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.915275] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d38273aa-e7d2-4aea-bcb1-2f5ae899e71f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.915545] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d38273aa-e7d2-4aea-bcb1-2f5ae899e71f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.915799] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d38273aa-e7d2-4aea-bcb1-2f5ae899e71f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.916641] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e6d7baac-4bff-46b9-b88d-2dc982621c0f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.916796] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.916796] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.916949] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.917032] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e6d7baac-4bff-46b9-b88d-2dc982621c0f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.918183] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ed4053b7-493c-48f8-b82e-b002cbcc3a61 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.918183] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.918183] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.918402] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.918567] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ed4053b7-493c-48f8-b82e-b002cbcc3a61',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.919663] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c587345b-51c8-42f7-8a0c-052027c4b18c taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.919823] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c587345b-51c8-42f7-8a0c-052027c4b18c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.919823] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c587345b-51c8-42f7-8a0c-052027c4b18c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.919973] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c587345b-51c8-42f7-8a0c-052027c4b18c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.920043] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c587345b-51c8-42f7-8a0c-052027c4b18c',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.921590] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b95b4f27-41f6-4a01-a1aa-aa16348ad807 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.921590] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b95b4f27-41f6-4a01-a1aa-aa16348ad807" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.921590] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b95b4f27-41f6-4a01-a1aa-aa16348ad807" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.921590] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b95b4f27-41f6-4a01-a1aa-aa16348ad807" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.921590] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b95b4f27-41f6-4a01-a1aa-aa16348ad807',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.922043] env[65065]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 21, greater than warning threshold: 20. There could be a leak. Increasing threshold to: 40 [ 799.922589] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-83648dc4-e98f-47b1-b96c-2c0a05ebae74 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.922589] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-83648dc4-e98f-47b1-b96c-2c0a05ebae74" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.922778] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-83648dc4-e98f-47b1-b96c-2c0a05ebae74" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.922778] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-83648dc4-e98f-47b1-b96c-2c0a05ebae74" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.922876] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('83648dc4-e98f-47b1-b96c-2c0a05ebae74',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.927372] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.927372] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.927372] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.927640] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.115765] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.116023] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.116147] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.116213] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.116558] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.116648] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.116738] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9576b45f-b344-47bd-8f8b-9df4c3725ddb is going to be updated. [ 800.121423] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7299f16a-2557-464b-9f29-2b3b8469fc29',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.166021] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.167574] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.167574] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.167574] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.167731] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.180972] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9576b45f-b344-47bd-8f8b-9df4c3725ddb in Status: IN_PROGRESS for 2s [ 800.432038] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9002bdd-0416-4909-9ac7-2b8cecd66558 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.432038] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9002bdd-0416-4909-9ac7-2b8cecd66558" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.432038] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9002bdd-0416-4909-9ac7-2b8cecd66558" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.432038] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9002bdd-0416-4909-9ac7-2b8cecd66558" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.432038] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.432038] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.432038] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.432038] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.432038] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.432038] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9002bdd-0416-4909-9ac7-2b8cecd66558" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.432038] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f9002bdd-0416-4909-9ac7-2b8cecd66558',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.450023] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.450745] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.450745] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.450953] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.475326] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.475472] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 16e2d0aa-9161-41ee-99b8-486218dfa51d is going to be deleted. [ 800.537963] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.537963] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.537963] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.537963] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.537963] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.537963] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-16e2d0aa-9161-41ee-99b8-486218dfa51d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.615880] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-c587345b-51c8-42f7-8a0c-052027c4b18c taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.616123] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c587345b-51c8-42f7-8a0c-052027c4b18c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.616494] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c587345b-51c8-42f7-8a0c-052027c4b18c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.616847] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c587345b-51c8-42f7-8a0c-052027c4b18c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.618180] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.618180] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.618180] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.618180] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.618180] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.618180] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c587345b-51c8-42f7-8a0c-052027c4b18c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.618180] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c587345b-51c8-42f7-8a0c-052027c4b18c',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.627382] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed4053b7-493c-48f8-b82e-b002cbcc3a61 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.627536] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.627593] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.627807] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.627971] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.628079] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.628145] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.628301] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.628387] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.628473] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.628661] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ed4053b7-493c-48f8-b82e-b002cbcc3a61',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.630765] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-c16acdbe-d600-40de-b3d9-384201f1e513 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.630765] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c16acdbe-d600-40de-b3d9-384201f1e513" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.630765] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c16acdbe-d600-40de-b3d9-384201f1e513" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.630765] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c16acdbe-d600-40de-b3d9-384201f1e513" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.630765] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.630765] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.630765] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.630765] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.630765] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.631201] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c16acdbe-d600-40de-b3d9-384201f1e513" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.631201] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c16acdbe-d600-40de-b3d9-384201f1e513',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.636039] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6d7baac-4bff-46b9-b88d-2dc982621c0f taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.636177] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.636229] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.636414] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.636566] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.636680] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.636751] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.636900] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.637029] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.637080] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.637162] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e6d7baac-4bff-46b9-b88d-2dc982621c0f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.639630] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.639630] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.639758] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.639878] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.639964] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.640068] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7299f16a-2557-464b-9f29-2b3b8469fc29 is going to be created. [ 800.645875] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-d38273aa-e7d2-4aea-bcb1-2f5ae899e71f taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.645875] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d38273aa-e7d2-4aea-bcb1-2f5ae899e71f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.645875] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d38273aa-e7d2-4aea-bcb1-2f5ae899e71f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.645875] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d38273aa-e7d2-4aea-bcb1-2f5ae899e71f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.645875] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.645875] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.645875] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.645875] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.645875] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.645875] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d38273aa-e7d2-4aea-bcb1-2f5ae899e71f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.645875] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d38273aa-e7d2-4aea-bcb1-2f5ae899e71f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.647335] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-b95b4f27-41f6-4a01-a1aa-aa16348ad807 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.647446] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b95b4f27-41f6-4a01-a1aa-aa16348ad807" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.647513] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b95b4f27-41f6-4a01-a1aa-aa16348ad807" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.647732] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b95b4f27-41f6-4a01-a1aa-aa16348ad807" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.647834] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.647902] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.648194] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.648194] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.648281] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.648342] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b95b4f27-41f6-4a01-a1aa-aa16348ad807" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.648423] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b95b4f27-41f6-4a01-a1aa-aa16348ad807',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.650590] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-45ff18a7-4a73-49de-af36-6c1d70b047f6 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.650590] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45ff18a7-4a73-49de-af36-6c1d70b047f6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.650737] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45ff18a7-4a73-49de-af36-6c1d70b047f6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.652090] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45ff18a7-4a73-49de-af36-6c1d70b047f6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.652090] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.652090] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.652090] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.652090] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.652090] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.652090] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45ff18a7-4a73-49de-af36-6c1d70b047f6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.652090] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('45ff18a7-4a73-49de-af36-6c1d70b047f6',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.659125] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.659265] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.659321] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.659526] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.701457] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.701457] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.702341] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.702341] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.703175] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.703507] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.708801] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.708988] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.710047] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.710153] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.712377] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.712377] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 39a21d13-3ed6-45f8-bfde-b892e16df2e1 is going to be deleted. [ 800.713412] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.713647] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.715537] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.715606] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.716461] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.716578] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.718108] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.718227] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.719085] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.719198] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.720044] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.720284] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.737178] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.737329] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.737401] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.737619] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.737779] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.748242] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.748408] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 960b9480-1a74-45ed-ba3b-4c9311dd370c is going to be deleted. [ 800.749792] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.750013] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.751632] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7299f16a-2557-464b-9f29-2b3b8469fc29 in Status: UNINITIALIZED for 2s [ 800.763312] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7006bfc-4bfa-49da-a51e-6cc26b8098c3 in Status: SUCCESS [ 800.763632] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7006bfc-4bfa-49da-a51e-6cc26b8098c3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.763830] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7006bfc-4bfa-49da-a51e-6cc26b8098c3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.764074] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7006bfc-4bfa-49da-a51e-6cc26b8098c3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.764269] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.764388] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.764465] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.764609] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.764701] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.764766] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7006bfc-4bfa-49da-a51e-6cc26b8098c3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.764858] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a7006bfc-4bfa-49da-a51e-6cc26b8098c3',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.780251] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.780251] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 83648dc4-e98f-47b1-b96c-2c0a05ebae74 is going to be deleted. [ 800.780754] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.780980] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.792949] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.793105] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.803554] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.803554] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5e981dae-b2fb-4490-8e25-4c38eb726ea5 is going to be deleted. [ 800.807020] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.807020] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.850484] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.850653] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.857942] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.858195] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1cb445c1-075d-4f89-884f-a4bbf84030d0 is going to be deleted. [ 800.859971] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.860262] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.916673] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.916884] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.927038] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.927301] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 620bfc73-f8be-4924-840f-8cc06371ccef is going to be deleted. [ 800.928707] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.929020] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.937440] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f9002bdd-0416-4909-9ac7-2b8cecd66558',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.981515] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.981806] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.046230] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.046230] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 45d9fbda-3bbf-490e-af96-b968c92e95ba is going to be deleted. [ 801.046230] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.046230] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.122136] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c587345b-51c8-42f7-8a0c-052027c4b18c',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.124283] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.124283] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 64777a42-07f5-4e1e-a53c-afd2accca690 is going to be deleted. [ 801.125765] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.125765] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.132894] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed4053b7-493c-48f8-b82e-b002cbcc3a61 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.132894] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.133172] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.133172] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.133351] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.133456] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.133494] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.133650] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.133746] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.133888] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.134082] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed4053b7-493c-48f8-b82e-b002cbcc3a61 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.134182] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.134246] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.134391] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.134527] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.134618] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.134679] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.134816] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.134925] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.135055] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.135152] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ed4053b7-493c-48f8-b82e-b002cbcc3a61',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.150641] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.150641] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.153690] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.153690] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.155662] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b95b4f27-41f6-4a01-a1aa-aa16348ad807',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.157398] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c16acdbe-d600-40de-b3d9-384201f1e513',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.161744] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d38273aa-e7d2-4aea-bcb1-2f5ae899e71f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.162333] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6d7baac-4bff-46b9-b88d-2dc982621c0f taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.162471] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.162559] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.162998] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.162998] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.162998] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.162998] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.163210] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.163244] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.163402] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.165422] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6d7baac-4bff-46b9-b88d-2dc982621c0f taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.165422] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.165422] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.165422] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.165422] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.165422] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.165422] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.165422] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.165422] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.165422] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.165422] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e6d7baac-4bff-46b9-b88d-2dc982621c0f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.168762] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-45ff18a7-4a73-49de-af36-6c1d70b047f6 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.168946] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45ff18a7-4a73-49de-af36-6c1d70b047f6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.169065] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45ff18a7-4a73-49de-af36-6c1d70b047f6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.169492] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45ff18a7-4a73-49de-af36-6c1d70b047f6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.169604] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.169746] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.170752] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.170752] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.170752] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.170752] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45ff18a7-4a73-49de-af36-6c1d70b047f6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.170752] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-45ff18a7-4a73-49de-af36-6c1d70b047f6 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.170752] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45ff18a7-4a73-49de-af36-6c1d70b047f6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.170752] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45ff18a7-4a73-49de-af36-6c1d70b047f6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.170752] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45ff18a7-4a73-49de-af36-6c1d70b047f6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.171517] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.171517] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.171517] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.171517] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.171517] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.171517] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45ff18a7-4a73-49de-af36-6c1d70b047f6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.171517] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('45ff18a7-4a73-49de-af36-6c1d70b047f6',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.173343] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.173503] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 36775ca6-e5c8-4c23-bad8-a30192db7f3f is going to be deleted. [ 801.174510] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.174768] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.229272] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.229452] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.236238] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.236238] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ffd44fac-c762-408c-862b-ccea34e00947 is going to be deleted. [ 801.237440] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.237771] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.267382] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7006bfc-4bfa-49da-a51e-6cc26b8098c3 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.268122] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7006bfc-4bfa-49da-a51e-6cc26b8098c3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.268366] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7006bfc-4bfa-49da-a51e-6cc26b8098c3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.268691] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7006bfc-4bfa-49da-a51e-6cc26b8098c3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.268875] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.269940] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.269940] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.269940] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.269940] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.269940] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7006bfc-4bfa-49da-a51e-6cc26b8098c3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.269940] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7006bfc-4bfa-49da-a51e-6cc26b8098c3 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.269940] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7006bfc-4bfa-49da-a51e-6cc26b8098c3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.269940] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7006bfc-4bfa-49da-a51e-6cc26b8098c3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.269940] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7006bfc-4bfa-49da-a51e-6cc26b8098c3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.270306] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.270306] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.270306] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.271159] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.271159] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.271159] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7006bfc-4bfa-49da-a51e-6cc26b8098c3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.271159] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a7006bfc-4bfa-49da-a51e-6cc26b8098c3',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.283756] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.283955] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.295322] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.295322] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.304064] env[65065]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 801.304162] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.304258] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8a13ba64-a593-4798-b668-78791377ba50 is going to be deleted. [ 801.305527] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.305774] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.305868] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.305997] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-39a21d13-3ed6-45f8-bfde-b892e16df2e1" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.306182] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.306351] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.306449] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.306572] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-960b9480-1a74-45ed-ba3b-4c9311dd370c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.307198] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.307320] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.307401] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.307515] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-83648dc4-e98f-47b1-b96c-2c0a05ebae74" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.307667] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.307857] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.307986] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.308054] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5e981dae-b2fb-4490-8e25-4c38eb726ea5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.308185] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.308417] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.308417] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.308595] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1cb445c1-075d-4f89-884f-a4bbf84030d0" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.308595] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.308751] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.308825] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.308939] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-620bfc73-f8be-4924-840f-8cc06371ccef" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.309531] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.309747] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.309876] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.309949] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-45d9fbda-3bbf-490e-af96-b968c92e95ba" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.310116] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.310258] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.310364] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.310451] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-64777a42-07f5-4e1e-a53c-afd2accca690" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.310579] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.310797] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.311249] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.311387] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-36775ca6-e5c8-4c23-bad8-a30192db7f3f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.385171] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.385378] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.385430] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.385628] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.385722] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.385845] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.412417] env[65065]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 801.412565] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.412658] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.412715] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.412908] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.413042] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.413143] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8a13ba64-a593-4798-b668-78791377ba50" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.441512] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f9002bdd-0416-4909-9ac7-2b8cecd66558: rpc.has_security_group_logging(os_id): False [ 801.467438] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.467649] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.467649] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.467816] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.513402] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.513608] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.513777] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.513777] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.514215] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.514287] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.514386] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f9002bdd-0416-4909-9ac7-2b8cecd66558 is going to be updated. [ 801.627203] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c587345b-51c8-42f7-8a0c-052027c4b18c: rpc.has_security_group_logging(os_id): False [ 801.633429] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.633617] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.633736] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.633855] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.634025] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.637714] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ed4053b7-493c-48f8-b82e-b002cbcc3a61: rpc.has_security_group_logging(os_id): False [ 801.650061] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.650061] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.650061] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.650356] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.653815] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f9002bdd-0416-4909-9ac7-2b8cecd66558 in Status: IN_PROGRESS for 2s [ 801.658950] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b95b4f27-41f6-4a01-a1aa-aa16348ad807: rpc.has_security_group_logging(os_id): False [ 801.660248] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.660360] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.660565] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c16acdbe-d600-40de-b3d9-384201f1e513: rpc.has_security_group_logging(os_id): False [ 801.666133] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d38273aa-e7d2-4aea-bcb1-2f5ae899e71f: rpc.has_security_group_logging(os_id): False [ 801.667487] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e6d7baac-4bff-46b9-b88d-2dc982621c0f: rpc.has_security_group_logging(os_id): False [ 801.677304] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 45ff18a7-4a73-49de-af36-6c1d70b047f6: rpc.has_security_group_logging(os_id): False [ 801.679552] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.679952] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.680085] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.680168] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.680421] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.680855] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.680855] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c587345b-51c8-42f7-8a0c-052027c4b18c is going to be updated. [ 801.683045] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.683045] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.684884] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.685030] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.685846] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.685976] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.687810] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.687928] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.688745] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.688850] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.704469] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.704609] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.714259] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.714584] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.715475] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.715475] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.715475] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.715475] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.715475] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.715475] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.716137] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.716137] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.716137] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.716137] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.719282] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.719282] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.719282] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.719282] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.719282] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ed4053b7-493c-48f8-b82e-b002cbcc3a61 is going to be updated. [ 801.719282] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.719282] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.771884] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.772208] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.772307] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.772373] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.772597] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.772681] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.772781] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c16acdbe-d600-40de-b3d9-384201f1e513 is going to be updated. [ 801.773978] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.774199] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.775175] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a7006bfc-4bfa-49da-a51e-6cc26b8098c3: rpc.has_security_group_logging(os_id): False [ 801.792089] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.792255] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.799453] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.799453] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.803038] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.803196] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.803308] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.803308] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.803518] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.803584] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.803739] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.803826] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.803909] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.804043] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.804114] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.804305] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.804424] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.804424] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.804969] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.804969] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.804969] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e6d7baac-4bff-46b9-b88d-2dc982621c0f is going to be updated. [ 801.805818] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.805978] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.867435] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.867435] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.871146] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.871500] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.871637] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.871705] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.871919] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.872011] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.872237] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.872327] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.872392] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.872551] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.872629] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.872844] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.872938] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.873019] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.873341] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.873341] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.873440] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 45ff18a7-4a73-49de-af36-6c1d70b047f6 is going to be updated. [ 801.874675] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.875306] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.908948] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.909200] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.990692] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.990962] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.991114] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.991178] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.991365] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.991454] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.991639] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d38273aa-e7d2-4aea-bcb1-2f5ae899e71f is going to be updated. [ 801.995520] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.995742] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.025226] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.025469] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.039514] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.039841] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.039960] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.040034] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.040263] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.040349] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.040549] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.040675] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.040879] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.040879] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.041011] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.041116] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.041197] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.041253] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.041385] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.041461] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.041572] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a7006bfc-4bfa-49da-a51e-6cc26b8098c3 is going to be updated. [ 802.042715] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.042879] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.043037] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.043955] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.044132] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.044260] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.045213] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.045367] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.045476] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.046401] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.046469] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.071097] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c587345b-51c8-42f7-8a0c-052027c4b18c in Status: IN_PROGRESS for 2s [ 802.073021] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c16acdbe-d600-40de-b3d9-384201f1e513 in Status: IN_PROGRESS for 2s [ 802.074026] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.074459] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.074568] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.074629] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.074879] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.074968] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.075066] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b95b4f27-41f6-4a01-a1aa-aa16348ad807 is going to be updated. [ 802.076236] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.076439] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.076603] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.085291] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ed4053b7-493c-48f8-b82e-b002cbcc3a61 in Status: IN_PROGRESS for 2s [ 802.108974] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.109385] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.109385] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.109385] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.109644] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.158926] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.159211] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.159211] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.159381] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.159534] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.166864] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e6d7baac-4bff-46b9-b88d-2dc982621c0f in Status: IN_PROGRESS for 2s [ 802.167632] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 45ff18a7-4a73-49de-af36-6c1d70b047f6 in Status: IN_PROGRESS for 2s [ 802.172091] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.172287] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.172357] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.172540] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.172738] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.210562] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9576b45f-b344-47bd-8f8b-9df4c3725ddb in Status: SUCCESS [ 802.210766] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9576b45f-b344-47bd-8f8b-9df4c3725ddb deletion is rescheduled due to dependency. [ 802.210866] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9576b45f-b344-47bd-8f8b-9df4c3725ddb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.220476] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a7006bfc-4bfa-49da-a51e-6cc26b8098c3 in Status: IN_PROGRESS for 2s [ 802.221667] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d38273aa-e7d2-4aea-bcb1-2f5ae899e71f in Status: IN_PROGRESS for 2s [ 802.282917] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.284083] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.284083] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.284083] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.284083] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.311657] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b95b4f27-41f6-4a01-a1aa-aa16348ad807 in Status: IN_PROGRESS for 2s [ 802.763661] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7299f16a-2557-464b-9f29-2b3b8469fc29 in Status: SUCCESS [ 802.763885] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7299f16a-2557-464b-9f29-2b3b8469fc29" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.764073] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7299f16a-2557-464b-9f29-2b3b8469fc29" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.764312] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7299f16a-2557-464b-9f29-2b3b8469fc29" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.764616] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.764616] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.764723] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.764822] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.764899] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.764983] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7299f16a-2557-464b-9f29-2b3b8469fc29" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.765089] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7299f16a-2557-464b-9f29-2b3b8469fc29',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.268035] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7299f16a-2557-464b-9f29-2b3b8469fc29',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.670753] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f9002bdd-0416-4909-9ac7-2b8cecd66558 in Status: SUCCESS [ 803.671256] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f9002bdd-0416-4909-9ac7-2b8cecd66558" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.771506] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7299f16a-2557-464b-9f29-2b3b8469fc29: rpc.has_security_group_logging(os_id): False [ 803.791555] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.791728] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.791799] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.792032] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.792120] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.792363] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.792461] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.792524] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.792728] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.792802] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.792839] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7299f16a-2557-464b-9f29-2b3b8469fc29 is going to be created. [ 803.862890] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.863069] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.863160] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.863347] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.863541] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.877784] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7299f16a-2557-464b-9f29-2b3b8469fc29 in Status: IN_PROGRESS for 2s [ 804.090410] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c587345b-51c8-42f7-8a0c-052027c4b18c in Status: SUCCESS [ 804.090597] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c587345b-51c8-42f7-8a0c-052027c4b18c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.092096] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c16acdbe-d600-40de-b3d9-384201f1e513 in Status: SUCCESS [ 804.092096] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c16acdbe-d600-40de-b3d9-384201f1e513" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.108790] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ed4053b7-493c-48f8-b82e-b002cbcc3a61 in Status: SUCCESS [ 804.108790] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.185121] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e6d7baac-4bff-46b9-b88d-2dc982621c0f in Status: SUCCESS [ 804.185413] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.186180] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 45ff18a7-4a73-49de-af36-6c1d70b047f6 in Status: SUCCESS [ 804.186364] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-45ff18a7-4a73-49de-af36-6c1d70b047f6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.235317] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d38273aa-e7d2-4aea-bcb1-2f5ae899e71f in Status: SUCCESS [ 804.235532] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d38273aa-e7d2-4aea-bcb1-2f5ae899e71f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.237303] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a7006bfc-4bfa-49da-a51e-6cc26b8098c3 in Status: SUCCESS [ 804.237303] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a7006bfc-4bfa-49da-a51e-6cc26b8098c3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.326220] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b95b4f27-41f6-4a01-a1aa-aa16348ad807 in Status: SUCCESS [ 804.326599] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b95b4f27-41f6-4a01-a1aa-aa16348ad807" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.888203] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 804.888203] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 805.890752] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7299f16a-2557-464b-9f29-2b3b8469fc29 in Status: SUCCESS [ 805.890752] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7299f16a-2557-464b-9f29-2b3b8469fc29" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.217403] env[65065]: INFO networking_nsxv3.common.synchronization [req-1eb2a2b0-e161-4eda-9322-4573dc70dc8f req-fddcfe01-b58c-47c2-b07c-f9aaa0f51564 tempest-ServersNegativeTestJSON-1748204548 tempest-ServersNegativeTestJSON-1748204548-project-member] Enqueued Resource ID: a793cfdd-5070-4bec-85b3-ff10a26c966f with Priority: HIGHEST for action security_group_members [ 808.217985] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a793cfdd-5070-4bec-85b3-ff10a26c966f with Priority: HIGHEST for action security_group_members [ 808.218302] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-a793cfdd-5070-4bec-85b3-ff10a26c966f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.218439] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a793cfdd-5070-4bec-85b3-ff10a26c966f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.218498] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a793cfdd-5070-4bec-85b3-ff10a26c966f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.218817] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a793cfdd-5070-4bec-85b3-ff10a26c966f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.218972] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.219150] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.219215] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.219372] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.219455] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.219548] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a793cfdd-5070-4bec-85b3-ff10a26c966f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.501875] env[65065]: INFO networking_nsxv3.common.synchronization [req-59893243-4049-4408-934f-330be4e0f93a req-235a87e2-aea4-4868-b917-85c5e0f8755a tempest-ServersAdminTestJSON-1746807080 tempest-ServersAdminTestJSON-1746807080-project-member] Enqueued Resource ID: ed4053b7-493c-48f8-b82e-b002cbcc3a61 with Priority: HIGHEST for action security_group_members [ 808.501875] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed4053b7-493c-48f8-b82e-b002cbcc3a61 with Priority: HIGHEST for action security_group_members [ 808.507974] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed4053b7-493c-48f8-b82e-b002cbcc3a61 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.508139] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.508216] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.508422] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.508657] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.508766] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.508827] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.508979] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.509200] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.509200] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ed4053b7-493c-48f8-b82e-b002cbcc3a61',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.723850] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.724129] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.724272] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.724611] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.724758] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.725053] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.725167] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.725233] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.725414] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.725520] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.725643] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a793cfdd-5070-4bec-85b3-ff10a26c966f already deleted. [ 808.725737] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a793cfdd-5070-4bec-85b3-ff10a26c966f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.844465] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock network-887 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.844676] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "network-887" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.844803] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "network-887" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.845187] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "network-887" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.845629] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.845813] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.845927] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.846183] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.846436] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.846714] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 808.846836] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 808.846958] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 808.847076] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 808.847209] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 808.847315] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 808.847457] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 808.876321] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 808.876505] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 808.876723] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 808.876925] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "network-887" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.877203] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock port-fb4e7136-3a92-4b72-a37a-3c826da7fbd9 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.877382] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "port-fb4e7136-3a92-4b72-a37a-3c826da7fbd9" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.877495] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "port-fb4e7136-3a92-4b72-a37a-3c826da7fbd9" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.877839] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "port-fb4e7136-3a92-4b72-a37a-3c826da7fbd9" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.877975] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb4e7136-3a92-4b72-a37a-3c826da7fbd9',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.013244] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ed4053b7-493c-48f8-b82e-b002cbcc3a61',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.381248] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.382121] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.382121] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.382121] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.382291] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.382442] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Segment Port fb4e7136-3a92-4b72-a37a-3c826da7fbd9 not found, creating... [ 809.382721] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.382913] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.383048] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.383277] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.383407] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.383721] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.383920] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.384350] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.384817] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.385040] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.385382] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Resource: SegmentPort with ID: fb4e7136-3a92-4b72-a37a-3c826da7fbd9 is going to be created. [ 809.405307] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.405527] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.405635] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.405910] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.406181] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.406403] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "port-fb4e7136-3a92-4b72-a37a-3c826da7fbd9" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.517717] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ed4053b7-493c-48f8-b82e-b002cbcc3a61',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.022323] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.022733] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.022835] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.023098] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.023208] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.023330] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ed4053b7-493c-48f8-b82e-b002cbcc3a61 is going to be updated. [ 810.057564] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.057745] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.057828] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.058086] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.058247] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.068754] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed4053b7-493c-48f8-b82e-b002cbcc3a61 in Status: IN_PROGRESS for 2s [ 810.107979] env[65065]: INFO networking_nsxv3.common.synchronization [req-1eb2a2b0-e161-4eda-9322-4573dc70dc8f req-3cecf9fe-c59c-4c92-98fa-35309b0c9a2e service nova] Enqueued Resource ID: a793cfdd-5070-4bec-85b3-ff10a26c966f with Priority: HIGHEST for action security_group_rules [ 810.108171] env[65065]: INFO networking_nsxv3.common.synchronization [req-1eb2a2b0-e161-4eda-9322-4573dc70dc8f req-3cecf9fe-c59c-4c92-98fa-35309b0c9a2e service nova] Enqueued Resource ID: a793cfdd-5070-4bec-85b3-ff10a26c966f with Priority: HIGHEST for action security_group_members [ 810.108309] env[65065]: INFO networking_nsxv3.common.synchronization [req-1eb2a2b0-e161-4eda-9322-4573dc70dc8f req-3cecf9fe-c59c-4c92-98fa-35309b0c9a2e service nova] Enqueued Resource ID: fb4e7136-3a92-4b72-a37a-3c826da7fbd9 with Priority: HIGHEST for action port [ 810.108958] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a793cfdd-5070-4bec-85b3-ff10a26c966f with Priority: HIGHEST for action security_group_rules [ 810.109422] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a793cfdd-5070-4bec-85b3-ff10a26c966f with Priority: HIGHEST for action security_group_members [ 810.109930] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb4e7136-3a92-4b72-a37a-3c826da7fbd9 with Priority: HIGHEST for action port [ 810.110297] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a793cfdd-5070-4bec-85b3-ff10a26c966f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.110427] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a793cfdd-5070-4bec-85b3-ff10a26c966f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.110485] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a793cfdd-5070-4bec-85b3-ff10a26c966f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.111172] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a793cfdd-5070-4bec-85b3-ff10a26c966f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.111280] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a793cfdd-5070-4bec-85b3-ff10a26c966f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.112606] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-a793cfdd-5070-4bec-85b3-ff10a26c966f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.112820] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a793cfdd-5070-4bec-85b3-ff10a26c966f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.112925] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a793cfdd-5070-4bec-85b3-ff10a26c966f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.113090] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a793cfdd-5070-4bec-85b3-ff10a26c966f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.113431] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.113567] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.113630] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.113814] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.115641] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.115751] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a793cfdd-5070-4bec-85b3-ff10a26c966f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.116685] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-fb4e7136-3a92-4b72-a37a-3c826da7fbd9 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.116790] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fb4e7136-3a92-4b72-a37a-3c826da7fbd9" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.116908] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fb4e7136-3a92-4b72-a37a-3c826da7fbd9" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.117054] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fb4e7136-3a92-4b72-a37a-3c826da7fbd9" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.117126] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb4e7136-3a92-4b72-a37a-3c826da7fbd9',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.523484] env[65065]: INFO networking_nsxv3.common.synchronization [req-88c274a3-c4ed-4177-82fb-2ceedc05fa75 req-95f36a0c-86b5-46ac-b640-289496c2e42f tempest-FloatingIPsAssociationTestJSON-1239844979 tempest-FloatingIPsAssociationTestJSON-1239844979-project-member] Enqueued Resource ID: a7006bfc-4bfa-49da-a51e-6cc26b8098c3 with Priority: HIGHEST for action security_group_members [ 810.524048] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7006bfc-4bfa-49da-a51e-6cc26b8098c3 with Priority: HIGHEST for action security_group_members [ 810.524523] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7006bfc-4bfa-49da-a51e-6cc26b8098c3 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.524523] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7006bfc-4bfa-49da-a51e-6cc26b8098c3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.524660] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7006bfc-4bfa-49da-a51e-6cc26b8098c3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.524735] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7006bfc-4bfa-49da-a51e-6cc26b8098c3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.524875] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.524970] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.525050] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.525197] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.525277] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.525368] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a7006bfc-4bfa-49da-a51e-6cc26b8098c3',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.619167] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a793cfdd-5070-4bec-85b3-ff10a26c966f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.621029] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-a793cfdd-5070-4bec-85b3-ff10a26c966f taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.621266] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a793cfdd-5070-4bec-85b3-ff10a26c966f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.621943] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fb4e7136-3a92-4b72-a37a-3c826da7fbd9 with status ACTIVE [ 810.622228] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.622431] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.622431] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.622812] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.622951] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.623191] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.623337] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.623449] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.625600] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.625600] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.625600] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.625600] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.625600] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.625600] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.625600] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.625600] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fb4e7136-3a92-4b72-a37a-3c826da7fbd9 is going to be updated. [ 810.647114] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.647326] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.647402] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.647611] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.647745] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.647905] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fb4e7136-3a92-4b72-a37a-3c826da7fbd9" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.896774] env[65065]: INFO networking_nsxv3.common.synchronization [req-d45cab11-ca6e-4a03-b9de-2dae941286f3 req-096c6143-4964-4bf8-bd85-247a77ea3236 tempest-ServerDiskConfigTestJSON-975440465 tempest-ServerDiskConfigTestJSON-975440465-project-member] Enqueued Resource ID: ffd44fac-c762-408c-862b-ccea34e00947 with Priority: HIGHEST for action security_group_members [ 810.897374] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ffd44fac-c762-408c-862b-ccea34e00947 with Priority: HIGHEST for action security_group_members [ 810.898068] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-ffd44fac-c762-408c-862b-ccea34e00947 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.898068] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.898068] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.901408] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.901408] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.901713] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.901713] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.901817] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.901854] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.901997] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ffd44fac-c762-408c-862b-ccea34e00947',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.028177] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a7006bfc-4bfa-49da-a51e-6cc26b8098c3',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.124943] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a793cfdd-5070-4bec-85b3-ff10a26c966f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.248140] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock network-34 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.248140] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "network-34" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.248140] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "network-34" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.248291] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "network-34" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.248431] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.248625] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.248882] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.249283] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.249409] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.249645] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 811.249843] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 811.249989] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 811.250138] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 811.250280] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 811.250415] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 811.250573] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 811.270569] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 811.270725] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 811.270864] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 811.271092] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "network-34" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.272022] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock port-8ef6fdc6-1b7b-4193-bc27-a230c78ff8e0 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.272022] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "port-8ef6fdc6-1b7b-4193-bc27-a230c78ff8e0" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.272022] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "port-8ef6fdc6-1b7b-4193-bc27-a230c78ff8e0" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.272022] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "port-8ef6fdc6-1b7b-4193-bc27-a230c78ff8e0" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.272239] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8ef6fdc6-1b7b-4193-bc27-a230c78ff8e0',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.406397] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.406582] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.406676] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.406929] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.407060] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.407276] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.408410] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.408410] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.408410] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.408410] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.408410] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ffd44fac-c762-408c-862b-ccea34e00947 is going to be deleted. [ 811.438826] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.438826] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.438826] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.439778] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.439778] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.439778] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.534823] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a7006bfc-4bfa-49da-a51e-6cc26b8098c3',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.627567] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.630814] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.630814] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.630814] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.630814] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.630814] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a793cfdd-5070-4bec-85b3-ff10a26c966f is going to be created. [ 811.655717] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.656087] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.656087] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.656331] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.656521] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.667507] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a793cfdd-5070-4bec-85b3-ff10a26c966f in Status: UNINITIALIZED for 2s [ 811.775973] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.775973] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.776172] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.776516] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.776578] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.776713] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Segment Port 8ef6fdc6-1b7b-4193-bc27-a230c78ff8e0 not found, creating... [ 811.776992] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.777164] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.777275] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.777501] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.777636] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.777919] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.778082] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.778773] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.778773] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.778773] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.778950] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Resource: SegmentPort with ID: 8ef6fdc6-1b7b-4193-bc27-a230c78ff8e0 is going to be created. [ 811.800355] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.800648] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.800780] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.801075] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.801309] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.801545] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "port-8ef6fdc6-1b7b-4193-bc27-a230c78ff8e0" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.037681] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.037853] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.037931] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.038206] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.038296] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.038399] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a7006bfc-4bfa-49da-a51e-6cc26b8098c3 is going to be updated. [ 812.067548] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.067749] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.067846] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.068149] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.068390] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.080213] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7006bfc-4bfa-49da-a51e-6cc26b8098c3 in Status: IN_PROGRESS for 2s [ 812.081609] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed4053b7-493c-48f8-b82e-b002cbcc3a61 in Status: SUCCESS [ 812.081773] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.576433] env[65065]: INFO networking_nsxv3.common.synchronization [req-d45cab11-ca6e-4a03-b9de-2dae941286f3 req-abf7fe17-2492-48da-8944-934587f3492b service nova] Enqueued Resource ID: ffd44fac-c762-408c-862b-ccea34e00947 with Priority: HIGHEST for action security_group_rules [ 812.576786] env[65065]: INFO networking_nsxv3.common.synchronization [req-d45cab11-ca6e-4a03-b9de-2dae941286f3 req-abf7fe17-2492-48da-8944-934587f3492b service nova] Enqueued Resource ID: ffd44fac-c762-408c-862b-ccea34e00947 with Priority: HIGHEST for action security_group_members [ 812.576872] env[65065]: INFO networking_nsxv3.common.synchronization [req-d45cab11-ca6e-4a03-b9de-2dae941286f3 req-abf7fe17-2492-48da-8944-934587f3492b service nova] Enqueued Resource ID: 8ef6fdc6-1b7b-4193-bc27-a230c78ff8e0 with Priority: HIGHEST for action port [ 812.578458] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ffd44fac-c762-408c-862b-ccea34e00947 with Priority: HIGHEST for action security_group_rules [ 812.579780] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ffd44fac-c762-408c-862b-ccea34e00947 with Priority: HIGHEST for action security_group_members [ 812.579780] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ef6fdc6-1b7b-4193-bc27-a230c78ff8e0 with Priority: HIGHEST for action port [ 812.579780] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ffd44fac-c762-408c-862b-ccea34e00947 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.579780] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.579780] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.579780] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.579780] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ffd44fac-c762-408c-862b-ccea34e00947',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.580426] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-ffd44fac-c762-408c-862b-ccea34e00947 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.580847] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.580923] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.581123] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.581283] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.581383] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.581677] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.581677] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.581677] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.581784] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ffd44fac-c762-408c-862b-ccea34e00947',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.584430] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-8ef6fdc6-1b7b-4193-bc27-a230c78ff8e0 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.584550] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8ef6fdc6-1b7b-4193-bc27-a230c78ff8e0" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.584617] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8ef6fdc6-1b7b-4193-bc27-a230c78ff8e0" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.585264] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8ef6fdc6-1b7b-4193-bc27-a230c78ff8e0" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.585264] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8ef6fdc6-1b7b-4193-bc27-a230c78ff8e0',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.086874] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-ffd44fac-c762-408c-862b-ccea34e00947 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.087119] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.087429] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ffd44fac-c762-408c-862b-ccea34e00947',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.091218] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8ef6fdc6-1b7b-4193-bc27-a230c78ff8e0 with status ACTIVE [ 813.091425] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.091588] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.091687] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.092027] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.092027] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.092265] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.092265] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.092414] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.092537] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.092670] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.092960] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.093125] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.093234] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.093471] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.093655] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.093742] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8ef6fdc6-1b7b-4193-bc27-a230c78ff8e0 is going to be updated. [ 813.116317] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.116547] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.116547] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.116724] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.116925] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.117385] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8ef6fdc6-1b7b-4193-bc27-a230c78ff8e0" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.593026] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ffd44fac-c762-408c-862b-ccea34e00947',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.625650] env[65065]: INFO networking_nsxv3.common.synchronization [req-d4d2f0dd-c18d-4a46-84e0-601c5500075f req-0de881ae-bc7e-4f62-bb46-361fcafdd822 tempest-ImagesOneServerNegativeTestJSON-764093247 tempest-ImagesOneServerNegativeTestJSON-764093247-project-member] Enqueued Resource ID: 9ed22036-e9a4-4639-89b9-c743ca686b09 with Priority: HIGHEST for action security_group_members [ 813.625650] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ed22036-e9a4-4639-89b9-c743ca686b09 with Priority: HIGHEST for action security_group_members [ 813.625650] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ed22036-e9a4-4639-89b9-c743ca686b09 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.625650] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ed22036-e9a4-4639-89b9-c743ca686b09" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.625650] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ed22036-e9a4-4639-89b9-c743ca686b09" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.625991] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ed22036-e9a4-4639-89b9-c743ca686b09" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.626091] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.626219] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.626300] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.626464] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.626571] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.626662] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ed22036-e9a4-4639-89b9-c743ca686b09',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.677700] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a793cfdd-5070-4bec-85b3-ff10a26c966f in Status: SUCCESS [ 813.678054] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a793cfdd-5070-4bec-85b3-ff10a26c966f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.678237] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a793cfdd-5070-4bec-85b3-ff10a26c966f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.678686] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a793cfdd-5070-4bec-85b3-ff10a26c966f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.678686] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.678833] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.678877] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.679051] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.679127] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.679450] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a793cfdd-5070-4bec-85b3-ff10a26c966f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.679450] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a793cfdd-5070-4bec-85b3-ff10a26c966f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.090837] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7006bfc-4bfa-49da-a51e-6cc26b8098c3 in Status: SUCCESS [ 814.091124] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7006bfc-4bfa-49da-a51e-6cc26b8098c3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.096155] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.096155] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.096155] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.096155] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.096397] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.096397] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ffd44fac-c762-408c-862b-ccea34e00947 is going to be created. [ 814.121493] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.121493] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.121493] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.121769] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.121814] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.129803] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.129938] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.130053] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.130337] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.134878] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ffd44fac-c762-408c-862b-ccea34e00947 in Status: UNINITIALIZED for 2s [ 814.154191] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.154453] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.154588] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.154632] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.154827] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.154911] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.154999] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ed22036-e9a4-4639-89b9-c743ca686b09 is going to be updated. [ 814.165237] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock network-105 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.165430] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "network-105" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.165550] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "network-105" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.166028] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "network-105" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.166116] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.166219] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.166333] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.168131] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.169601] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.169904] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 814.170043] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 814.170160] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 814.170269] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 814.170384] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 814.170488] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 814.170621] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 814.188024] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-a793cfdd-5070-4bec-85b3-ff10a26c966f taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.188024] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a793cfdd-5070-4bec-85b3-ff10a26c966f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.188024] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a793cfdd-5070-4bec-85b3-ff10a26c966f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.188024] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a793cfdd-5070-4bec-85b3-ff10a26c966f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.188024] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.188024] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.188024] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.188024] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.188024] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.188024] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a793cfdd-5070-4bec-85b3-ff10a26c966f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.188024] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-a793cfdd-5070-4bec-85b3-ff10a26c966f taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.188024] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a793cfdd-5070-4bec-85b3-ff10a26c966f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.188024] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a793cfdd-5070-4bec-85b3-ff10a26c966f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.188024] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a793cfdd-5070-4bec-85b3-ff10a26c966f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.188024] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.188024] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.188816] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.188816] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.188816] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.188816] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a793cfdd-5070-4bec-85b3-ff10a26c966f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.188816] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a793cfdd-5070-4bec-85b3-ff10a26c966f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.195532] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.195837] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.195837] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.195938] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.196102] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.203056] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 814.203245] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Cache value generated in 0.033 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 814.204925] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 814.205164] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "network-105" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.205681] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock port-8a0ad9b3-4d3d-4b19-92fe-d9e0feb63345 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.205681] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "port-8a0ad9b3-4d3d-4b19-92fe-d9e0feb63345" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.205812] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "port-8a0ad9b3-4d3d-4b19-92fe-d9e0feb63345" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.206521] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "port-8a0ad9b3-4d3d-4b19-92fe-d9e0feb63345" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.206521] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8a0ad9b3-4d3d-4b19-92fe-d9e0feb63345',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.210240] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ed22036-e9a4-4639-89b9-c743ca686b09 in Status: IN_PROGRESS for 2s [ 814.690250] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a793cfdd-5070-4bec-85b3-ff10a26c966f: rpc.has_security_group_logging(os_id): False [ 814.710899] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.711064] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.711123] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.711399] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.711464] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.711646] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.711736] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.712160] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.712160] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.712160] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.712301] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.712301] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.712388] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.712479] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.712549] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.712808] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.712808] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.712907] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.713030] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.713075] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.713198] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a793cfdd-5070-4bec-85b3-ff10a26c966f is going to be created. [ 814.714626] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.714822] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.715414] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.715414] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.715414] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.715545] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Segment Port 8a0ad9b3-4d3d-4b19-92fe-d9e0feb63345 not found, creating... [ 814.715687] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.715858] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.716439] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.716439] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.716439] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.716828] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.716828] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.716828] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.717026] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.717164] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.718091] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Resource: SegmentPort with ID: 8a0ad9b3-4d3d-4b19-92fe-d9e0feb63345 is going to be created. [ 814.742060] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.742286] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.742580] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.742874] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.743639] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.743639] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "port-8a0ad9b3-4d3d-4b19-92fe-d9e0feb63345" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.801077] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.801077] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.801077] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.801077] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.801077] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.819493] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a793cfdd-5070-4bec-85b3-ff10a26c966f in Status: IN_PROGRESS for 2s [ 815.466709] env[65065]: INFO networking_nsxv3.common.synchronization [req-d4d2f0dd-c18d-4a46-84e0-601c5500075f req-5112fd3b-9a8c-4c96-9245-06ff791d6c0d service nova] Enqueued Resource ID: 9ed22036-e9a4-4639-89b9-c743ca686b09 with Priority: HIGHEST for action security_group_rules [ 815.466903] env[65065]: INFO networking_nsxv3.common.synchronization [req-d4d2f0dd-c18d-4a46-84e0-601c5500075f req-5112fd3b-9a8c-4c96-9245-06ff791d6c0d service nova] Enqueued Resource ID: 9ed22036-e9a4-4639-89b9-c743ca686b09 with Priority: HIGHEST for action security_group_members [ 815.467053] env[65065]: INFO networking_nsxv3.common.synchronization [req-d4d2f0dd-c18d-4a46-84e0-601c5500075f req-5112fd3b-9a8c-4c96-9245-06ff791d6c0d service nova] Enqueued Resource ID: 8a0ad9b3-4d3d-4b19-92fe-d9e0feb63345 with Priority: HIGHEST for action port [ 815.467680] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ed22036-e9a4-4639-89b9-c743ca686b09 with Priority: HIGHEST for action security_group_rules [ 815.467822] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ed22036-e9a4-4639-89b9-c743ca686b09 with Priority: HIGHEST for action security_group_members [ 815.467915] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a0ad9b3-4d3d-4b19-92fe-d9e0feb63345 with Priority: HIGHEST for action port [ 815.468292] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9ed22036-e9a4-4639-89b9-c743ca686b09 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.468451] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9ed22036-e9a4-4639-89b9-c743ca686b09" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.468538] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9ed22036-e9a4-4639-89b9-c743ca686b09" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.469042] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9ed22036-e9a4-4639-89b9-c743ca686b09" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.469145] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9ed22036-e9a4-4639-89b9-c743ca686b09',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.470162] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ed22036-e9a4-4639-89b9-c743ca686b09 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.470268] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ed22036-e9a4-4639-89b9-c743ca686b09" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.471337] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-8a0ad9b3-4d3d-4b19-92fe-d9e0feb63345 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.471518] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8a0ad9b3-4d3d-4b19-92fe-d9e0feb63345" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.471630] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8a0ad9b3-4d3d-4b19-92fe-d9e0feb63345" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.471950] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8a0ad9b3-4d3d-4b19-92fe-d9e0feb63345" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.472527] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8a0ad9b3-4d3d-4b19-92fe-d9e0feb63345',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.978425] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ed22036-e9a4-4639-89b9-c743ca686b09 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.978425] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ed22036-e9a4-4639-89b9-c743ca686b09" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.978425] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8a0ad9b3-4d3d-4b19-92fe-d9e0feb63345 with status ACTIVE [ 815.978425] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.978425] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.978425] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.978425] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.978980] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.978980] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.978980] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.978980] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.978980] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.979159] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.980097] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.980097] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.980097] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.980097] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.980097] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.982429] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8a0ad9b3-4d3d-4b19-92fe-d9e0feb63345 is going to be updated. [ 816.005394] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.005394] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.005394] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.005394] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.005394] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.005394] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8a0ad9b3-4d3d-4b19-92fe-d9e0feb63345" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.108503] env[65065]: INFO networking_nsxv3.common.synchronization [req-9ecd4455-8c71-485f-bc10-d2588b254fb0 req-cda71517-9ba8-4540-8c0f-6003e2d09826 tempest-ServerMetadataTestJSON-643522844 tempest-ServerMetadataTestJSON-643522844-project-member] Enqueued Resource ID: 1b329aa6-2b06-4112-ad10-7c2ede9e4774 with Priority: HIGHEST for action security_group_members [ 816.108961] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b329aa6-2b06-4112-ad10-7c2ede9e4774 with Priority: HIGHEST for action security_group_members [ 816.109305] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b329aa6-2b06-4112-ad10-7c2ede9e4774 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.109504] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b329aa6-2b06-4112-ad10-7c2ede9e4774" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.109504] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b329aa6-2b06-4112-ad10-7c2ede9e4774" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.109831] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b329aa6-2b06-4112-ad10-7c2ede9e4774" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.109904] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.110036] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.110147] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.110308] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.110407] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.110485] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1b329aa6-2b06-4112-ad10-7c2ede9e4774',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.147462] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ffd44fac-c762-408c-862b-ccea34e00947 in Status: SUCCESS [ 816.149038] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.149038] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.149038] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.149038] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.149038] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.149038] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.149038] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.149038] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.149038] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.149038] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ffd44fac-c762-408c-862b-ccea34e00947',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.222864] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ed22036-e9a4-4639-89b9-c743ca686b09 in Status: SUCCESS [ 816.223902] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ed22036-e9a4-4639-89b9-c743ca686b09 deletion is rescheduled due to dependency. [ 816.224272] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ed22036-e9a4-4639-89b9-c743ca686b09" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.224272] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ed22036-e9a4-4639-89b9-c743ca686b09" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.224514] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ed22036-e9a4-4639-89b9-c743ca686b09" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.224995] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.225221] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.225332] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.225597] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.225734] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.225898] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ed22036-e9a4-4639-89b9-c743ca686b09',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.474807] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock network-18 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.475085] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "network-18" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.475298] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "network-18" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.475788] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "network-18" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.476199] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.476422] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.476576] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.476949] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.477244] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.477604] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 816.477833] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 816.478056] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 816.478273] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 816.478554] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 816.478815] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 816.479072] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 816.508228] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 816.508228] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 816.508228] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 816.508228] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "network-18" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.508871] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock port-77ebd346-cfb1-4953-934b-4627880e0110 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.509720] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "port-77ebd346-cfb1-4953-934b-4627880e0110" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.509720] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "port-77ebd346-cfb1-4953-934b-4627880e0110" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.510253] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "port-77ebd346-cfb1-4953-934b-4627880e0110" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.510523] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('77ebd346-cfb1-4953-934b-4627880e0110',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.614801] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.614801] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.614801] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.614801] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.614801] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.614801] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.614801] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.614801] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.614801] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.614801] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.614801] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1b329aa6-2b06-4112-ad10-7c2ede9e4774 already deleted. [ 816.614801] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b329aa6-2b06-4112-ad10-7c2ede9e4774" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.653227] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-ffd44fac-c762-408c-862b-ccea34e00947 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.653392] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.653462] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.653802] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.653960] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.653960] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.655198] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.655410] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.655489] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.655584] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.656220] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-ffd44fac-c762-408c-862b-ccea34e00947 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.656220] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.656220] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.656433] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.656468] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.656688] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.656688] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.656772] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.656860] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.656901] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.656993] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ffd44fac-c762-408c-862b-ccea34e00947',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.728177] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9ed22036-e9a4-4639-89b9-c743ca686b09',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.830502] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a793cfdd-5070-4bec-85b3-ff10a26c966f in Status: SUCCESS [ 816.830802] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a793cfdd-5070-4bec-85b3-ff10a26c966f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.014243] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.014243] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.014243] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.014574] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.014890] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.015724] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Segment Port 77ebd346-cfb1-4953-934b-4627880e0110 not found, creating... [ 817.015724] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.015724] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.015945] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.016340] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.016509] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.016883] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.017101] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.017278] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.017685] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.017965] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.018714] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Resource: SegmentPort with ID: 77ebd346-cfb1-4953-934b-4627880e0110 is going to be created. [ 817.038877] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.040034] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.040034] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.040034] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.040034] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.040239] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "port-77ebd346-cfb1-4953-934b-4627880e0110" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.161248] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ffd44fac-c762-408c-862b-ccea34e00947: rpc.has_security_group_logging(os_id): False [ 817.188823] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.189037] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.189087] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.189276] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.189366] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.189554] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.189665] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.189747] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.189895] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.189971] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.190172] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.190262] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.190321] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.190457] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.190528] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.190893] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.190995] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.191079] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.191242] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.191316] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.191401] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ffd44fac-c762-408c-862b-ccea34e00947 is going to be created. [ 817.230400] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9ed22036-e9a4-4639-89b9-c743ca686b09',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.273922] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.274143] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.274215] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.274488] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.274699] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.291675] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ffd44fac-c762-408c-862b-ccea34e00947 in Status: IN_PROGRESS for 2s [ 817.732434] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.732594] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.732649] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.732918] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.733029] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.733135] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ed22036-e9a4-4639-89b9-c743ca686b09 is going to be updated. [ 817.741129] env[65065]: INFO networking_nsxv3.common.synchronization [req-9ecd4455-8c71-485f-bc10-d2588b254fb0 req-84b815df-c9cb-4682-a0a0-c5695f34ad80 service nova] Enqueued Resource ID: 1b329aa6-2b06-4112-ad10-7c2ede9e4774 with Priority: HIGHEST for action security_group_rules [ 817.741188] env[65065]: INFO networking_nsxv3.common.synchronization [req-9ecd4455-8c71-485f-bc10-d2588b254fb0 req-84b815df-c9cb-4682-a0a0-c5695f34ad80 service nova] Enqueued Resource ID: 1b329aa6-2b06-4112-ad10-7c2ede9e4774 with Priority: HIGHEST for action security_group_members [ 817.741333] env[65065]: INFO networking_nsxv3.common.synchronization [req-9ecd4455-8c71-485f-bc10-d2588b254fb0 req-84b815df-c9cb-4682-a0a0-c5695f34ad80 service nova] Enqueued Resource ID: 77ebd346-cfb1-4953-934b-4627880e0110 with Priority: HIGHEST for action port [ 817.741863] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b329aa6-2b06-4112-ad10-7c2ede9e4774 with Priority: HIGHEST for action security_group_rules [ 817.742009] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b329aa6-2b06-4112-ad10-7c2ede9e4774 with Priority: HIGHEST for action security_group_members [ 817.742235] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77ebd346-cfb1-4953-934b-4627880e0110 with Priority: HIGHEST for action port [ 817.742565] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1b329aa6-2b06-4112-ad10-7c2ede9e4774 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.742692] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1b329aa6-2b06-4112-ad10-7c2ede9e4774" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.742761] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1b329aa6-2b06-4112-ad10-7c2ede9e4774" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.743057] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1b329aa6-2b06-4112-ad10-7c2ede9e4774" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.743143] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1b329aa6-2b06-4112-ad10-7c2ede9e4774',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.744058] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b329aa6-2b06-4112-ad10-7c2ede9e4774 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.745093] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b329aa6-2b06-4112-ad10-7c2ede9e4774" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.745170] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b329aa6-2b06-4112-ad10-7c2ede9e4774" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.745459] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b329aa6-2b06-4112-ad10-7c2ede9e4774" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.745500] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.745606] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.745670] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.745830] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.745915] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.748214] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1b329aa6-2b06-4112-ad10-7c2ede9e4774',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.749126] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-77ebd346-cfb1-4953-934b-4627880e0110 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.749246] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-77ebd346-cfb1-4953-934b-4627880e0110" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.749309] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-77ebd346-cfb1-4953-934b-4627880e0110" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.749462] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-77ebd346-cfb1-4953-934b-4627880e0110" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.749548] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('77ebd346-cfb1-4953-934b-4627880e0110',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.765517] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.766083] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.766198] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.766460] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.766583] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.787177] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ed22036-e9a4-4639-89b9-c743ca686b09 in Status: IN_PROGRESS for 2s [ 818.251607] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b329aa6-2b06-4112-ad10-7c2ede9e4774 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.251901] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b329aa6-2b06-4112-ad10-7c2ede9e4774" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.251944] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1b329aa6-2b06-4112-ad10-7c2ede9e4774',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.257784] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 77ebd346-cfb1-4953-934b-4627880e0110 with status ACTIVE [ 818.258092] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.258867] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.258867] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.259973] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.259973] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.259973] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.259973] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.259973] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.259973] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.259973] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.260359] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.260359] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.260359] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.260468] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.260503] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.261061] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 77ebd346-cfb1-4953-934b-4627880e0110 is going to be updated. [ 818.284488] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.284742] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.284742] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.284915] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.285068] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.285223] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-77ebd346-cfb1-4953-934b-4627880e0110" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.482257] env[65065]: INFO networking_nsxv3.common.synchronization [None req-2ad5ac5e-7ca5-4c1e-882b-739739b32956 None None] Enqueued Resource ID: b6163b75-12ce-4e81-8fca-2dd50d9c0adc with Priority: HIGHEST for action port [ 818.483137] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6163b75-12ce-4e81-8fca-2dd50d9c0adc with Priority: HIGHEST for action port [ 818.483622] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-b6163b75-12ce-4e81-8fca-2dd50d9c0adc taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.483802] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b6163b75-12ce-4e81-8fca-2dd50d9c0adc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.483907] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b6163b75-12ce-4e81-8fca-2dd50d9c0adc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.484263] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b6163b75-12ce-4e81-8fca-2dd50d9c0adc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.484392] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b6163b75-12ce-4e81-8fca-2dd50d9c0adc',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.758143] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1b329aa6-2b06-4112-ad10-7c2ede9e4774',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.873861] env[65065]: INFO networking_nsxv3.common.synchronization [req-e09e7453-6106-4965-9073-c1fe6e4240ce req-6e471bae-a65b-4b3c-b76f-99c694196b45 tempest-InstanceActionsV221TestJSON-1734092346 tempest-InstanceActionsV221TestJSON-1734092346-project-member] Enqueued Resource ID: 5497a3e0-53ac-4406-b988-4b00f454ac4c with Priority: HIGHEST for action security_group_members [ 818.873861] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5497a3e0-53ac-4406-b988-4b00f454ac4c with Priority: HIGHEST for action security_group_members [ 818.874035] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-5497a3e0-53ac-4406-b988-4b00f454ac4c taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.875854] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5497a3e0-53ac-4406-b988-4b00f454ac4c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.875854] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5497a3e0-53ac-4406-b988-4b00f454ac4c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.875854] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5497a3e0-53ac-4406-b988-4b00f454ac4c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.876261] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.876261] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.876261] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.876454] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.876454] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.876588] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5497a3e0-53ac-4406-b988-4b00f454ac4c',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.991149] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b6163b75-12ce-4e81-8fca-2dd50d9c0adc [ 818.991149] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.991149] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.991149] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.991149] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.991149] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.991149] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b6163b75-12ce-4e81-8fca-2dd50d9c0adc already deleted. [ 818.991149] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b6163b75-12ce-4e81-8fca-2dd50d9c0adc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.261447] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.263317] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.263317] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.264135] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.264245] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.264311] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1b329aa6-2b06-4112-ad10-7c2ede9e4774 is going to be created. [ 819.293314] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.293978] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.294084] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.294299] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.294533] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.305387] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock network-245 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.305635] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "network-245" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.305692] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "network-245" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.307686] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "network-245" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.307686] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.307686] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.307686] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.307686] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.307964] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.308412] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 819.308412] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 819.308412] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 819.311236] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 819.311236] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 819.311236] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 819.311236] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 819.321960] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1b329aa6-2b06-4112-ad10-7c2ede9e4774 in Status: UNINITIALIZED for 2s [ 819.331153] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ffd44fac-c762-408c-862b-ccea34e00947 in Status: SUCCESS [ 819.331387] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.333495] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 819.333495] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 819.333495] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 819.333495] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "network-245" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.334577] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock port-f05ec1c0-9aee-42e3-97a5-78ebed0d680a taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.334807] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "port-f05ec1c0-9aee-42e3-97a5-78ebed0d680a" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.334954] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "port-f05ec1c0-9aee-42e3-97a5-78ebed0d680a" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.335342] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "port-f05ec1c0-9aee-42e3-97a5-78ebed0d680a" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.335514] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f05ec1c0-9aee-42e3-97a5-78ebed0d680a',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.381169] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.381169] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.381169] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.381479] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.381479] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.381583] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.381675] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.381738] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.381879] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.381977] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.382047] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5497a3e0-53ac-4406-b988-4b00f454ac4c already deleted. [ 819.382128] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5497a3e0-53ac-4406-b988-4b00f454ac4c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.801482] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ed22036-e9a4-4639-89b9-c743ca686b09 in Status: SUCCESS [ 819.801482] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ed22036-e9a4-4639-89b9-c743ca686b09" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.801482] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ed22036-e9a4-4639-89b9-c743ca686b09" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.801482] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ed22036-e9a4-4639-89b9-c743ca686b09" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.801482] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.801482] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.801482] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.801482] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.801482] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.801482] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ed22036-e9a4-4639-89b9-c743ca686b09" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.801482] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9ed22036-e9a4-4639-89b9-c743ca686b09',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.837939] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.838199] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.838325] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.838589] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.839475] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.839475] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Segment Port f05ec1c0-9aee-42e3-97a5-78ebed0d680a not found, creating... [ 819.840822] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.841153] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.841565] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.841565] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.841759] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.842096] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.844209] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.844209] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.844209] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.844209] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.844209] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Resource: SegmentPort with ID: f05ec1c0-9aee-42e3-97a5-78ebed0d680a is going to be created. [ 819.871625] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.871855] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.871980] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.872272] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.872499] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.872721] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "port-f05ec1c0-9aee-42e3-97a5-78ebed0d680a" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.305238] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ed22036-e9a4-4639-89b9-c743ca686b09 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.305238] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ed22036-e9a4-4639-89b9-c743ca686b09" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.305238] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ed22036-e9a4-4639-89b9-c743ca686b09" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.305238] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ed22036-e9a4-4639-89b9-c743ca686b09" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.305238] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.305238] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.305238] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.305238] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.305238] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.305238] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ed22036-e9a4-4639-89b9-c743ca686b09" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.305238] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ed22036-e9a4-4639-89b9-c743ca686b09 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.305238] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ed22036-e9a4-4639-89b9-c743ca686b09" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.305238] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ed22036-e9a4-4639-89b9-c743ca686b09" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.305238] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ed22036-e9a4-4639-89b9-c743ca686b09" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.305238] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.306351] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.306351] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.306351] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.306445] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.306607] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ed22036-e9a4-4639-89b9-c743ca686b09" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.306780] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9ed22036-e9a4-4639-89b9-c743ca686b09',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.615347] env[65065]: INFO networking_nsxv3.common.synchronization [req-e09e7453-6106-4965-9073-c1fe6e4240ce req-9b47eea6-49f4-4280-9867-e78cdc11ed90 service nova] Enqueued Resource ID: 5497a3e0-53ac-4406-b988-4b00f454ac4c with Priority: HIGHEST for action security_group_rules [ 820.615347] env[65065]: INFO networking_nsxv3.common.synchronization [req-e09e7453-6106-4965-9073-c1fe6e4240ce req-9b47eea6-49f4-4280-9867-e78cdc11ed90 service nova] Enqueued Resource ID: 5497a3e0-53ac-4406-b988-4b00f454ac4c with Priority: HIGHEST for action security_group_members [ 820.615347] env[65065]: INFO networking_nsxv3.common.synchronization [req-e09e7453-6106-4965-9073-c1fe6e4240ce req-9b47eea6-49f4-4280-9867-e78cdc11ed90 service nova] Enqueued Resource ID: f05ec1c0-9aee-42e3-97a5-78ebed0d680a with Priority: HIGHEST for action port [ 820.615347] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5497a3e0-53ac-4406-b988-4b00f454ac4c with Priority: HIGHEST for action security_group_rules [ 820.615347] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5497a3e0-53ac-4406-b988-4b00f454ac4c with Priority: HIGHEST for action security_group_members [ 820.615347] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f05ec1c0-9aee-42e3-97a5-78ebed0d680a with Priority: HIGHEST for action port [ 820.615347] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5497a3e0-53ac-4406-b988-4b00f454ac4c taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.615347] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5497a3e0-53ac-4406-b988-4b00f454ac4c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.615347] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5497a3e0-53ac-4406-b988-4b00f454ac4c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.616142] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5497a3e0-53ac-4406-b988-4b00f454ac4c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.616383] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5497a3e0-53ac-4406-b988-4b00f454ac4c',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.617509] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-5497a3e0-53ac-4406-b988-4b00f454ac4c taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.617784] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5497a3e0-53ac-4406-b988-4b00f454ac4c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.617946] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5497a3e0-53ac-4406-b988-4b00f454ac4c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.618366] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5497a3e0-53ac-4406-b988-4b00f454ac4c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.618624] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.618964] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.619562] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.619562] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.619562] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.619562] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5497a3e0-53ac-4406-b988-4b00f454ac4c',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.621314] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-f05ec1c0-9aee-42e3-97a5-78ebed0d680a taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.624634] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f05ec1c0-9aee-42e3-97a5-78ebed0d680a" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.624634] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f05ec1c0-9aee-42e3-97a5-78ebed0d680a" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.624634] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f05ec1c0-9aee-42e3-97a5-78ebed0d680a" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.624634] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f05ec1c0-9aee-42e3-97a5-78ebed0d680a',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.813223] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9ed22036-e9a4-4639-89b9-c743ca686b09: rpc.has_security_group_logging(os_id): False [ 820.832763] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.832994] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.833225] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.833658] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.834150] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.834474] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.835933] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.835933] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.835933] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.835933] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.835933] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.835933] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.835933] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.835933] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.836316] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.836514] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.836597] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.836683] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.837031] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.837545] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.837545] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9ed22036-e9a4-4639-89b9-c743ca686b09 is going to be updated. [ 820.896915] env[65065]: INFO networking_nsxv3.common.synchronization [None req-a25cf357-9dbd-484d-a030-1ddc7fe39983 None None] Enqueued Resource ID: fc14b60b-0bf2-4fe6-9872-22d4a9ef90c8 with Priority: HIGHEST for action port [ 820.897504] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc14b60b-0bf2-4fe6-9872-22d4a9ef90c8 with Priority: HIGHEST for action port [ 820.898509] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-fc14b60b-0bf2-4fe6-9872-22d4a9ef90c8 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.898720] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fc14b60b-0bf2-4fe6-9872-22d4a9ef90c8" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.898809] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fc14b60b-0bf2-4fe6-9872-22d4a9ef90c8" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.899211] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fc14b60b-0bf2-4fe6-9872-22d4a9ef90c8" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.899597] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fc14b60b-0bf2-4fe6-9872-22d4a9ef90c8',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.911034] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.911246] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.912036] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.912036] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.912036] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.939345] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9ed22036-e9a4-4639-89b9-c743ca686b09 in Status: IN_PROGRESS for 2s [ 821.124102] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5497a3e0-53ac-4406-b988-4b00f454ac4c',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.128034] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-5497a3e0-53ac-4406-b988-4b00f454ac4c taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.128034] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5497a3e0-53ac-4406-b988-4b00f454ac4c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.128034] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f05ec1c0-9aee-42e3-97a5-78ebed0d680a with status ACTIVE [ 821.128034] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.128034] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.128471] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.128471] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.128570] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.128922] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.129711] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.129711] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.129711] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.129711] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.130101] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.130177] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.130227] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.130455] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.130574] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.130706] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f05ec1c0-9aee-42e3-97a5-78ebed0d680a is going to be updated. [ 821.160124] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.160299] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.160371] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.160629] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.160782] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.160941] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f05ec1c0-9aee-42e3-97a5-78ebed0d680a" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.337028] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1b329aa6-2b06-4112-ad10-7c2ede9e4774 in Status: SUCCESS [ 821.337028] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b329aa6-2b06-4112-ad10-7c2ede9e4774" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.337028] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b329aa6-2b06-4112-ad10-7c2ede9e4774" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.337028] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b329aa6-2b06-4112-ad10-7c2ede9e4774" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.337028] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.337028] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.337028] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.337748] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.337748] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.337748] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b329aa6-2b06-4112-ad10-7c2ede9e4774" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.337909] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1b329aa6-2b06-4112-ad10-7c2ede9e4774',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.402880] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fc14b60b-0bf2-4fe6-9872-22d4a9ef90c8 [ 821.403319] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.403589] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.403721] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.403991] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.405042] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.405311] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fc14b60b-0bf2-4fe6-9872-22d4a9ef90c8 already deleted. [ 821.405397] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fc14b60b-0bf2-4fe6-9872-22d4a9ef90c8" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.627881] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5497a3e0-53ac-4406-b988-4b00f454ac4c',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.843981] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b329aa6-2b06-4112-ad10-7c2ede9e4774 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.843981] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b329aa6-2b06-4112-ad10-7c2ede9e4774" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.843981] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b329aa6-2b06-4112-ad10-7c2ede9e4774" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.844272] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b329aa6-2b06-4112-ad10-7c2ede9e4774" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.844272] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.844431] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.844431] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.844589] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.844669] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.844745] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b329aa6-2b06-4112-ad10-7c2ede9e4774" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.844892] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b329aa6-2b06-4112-ad10-7c2ede9e4774 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.844978] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b329aa6-2b06-4112-ad10-7c2ede9e4774" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.845056] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b329aa6-2b06-4112-ad10-7c2ede9e4774" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.845912] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b329aa6-2b06-4112-ad10-7c2ede9e4774" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.845912] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.845912] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.845912] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.845912] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.845912] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.845912] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b329aa6-2b06-4112-ad10-7c2ede9e4774" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.845912] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1b329aa6-2b06-4112-ad10-7c2ede9e4774',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.131782] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.132027] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.132125] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.132341] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.132431] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.132528] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5497a3e0-53ac-4406-b988-4b00f454ac4c is going to be created. [ 822.159968] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.159968] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.159968] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.159968] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.159968] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.170140] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5497a3e0-53ac-4406-b988-4b00f454ac4c in Status: UNINITIALIZED for 2s [ 822.349405] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1b329aa6-2b06-4112-ad10-7c2ede9e4774: rpc.has_security_group_logging(os_id): False [ 822.394094] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.394094] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.394094] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.394094] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.394094] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.394094] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.394094] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.394094] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.394094] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.394561] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.394561] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.394561] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.394561] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.394699] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.394699] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.394864] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.394970] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.395035] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.395260] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.395260] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.395372] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1b329aa6-2b06-4112-ad10-7c2ede9e4774 is going to be created. [ 822.470417] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.470910] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.471588] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.471946] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.472350] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.485828] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1b329aa6-2b06-4112-ad10-7c2ede9e4774 in Status: IN_PROGRESS for 2s [ 822.957279] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9ed22036-e9a4-4639-89b9-c743ca686b09 in Status: SUCCESS [ 822.957570] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9ed22036-e9a4-4639-89b9-c743ca686b09" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.184020] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5497a3e0-53ac-4406-b988-4b00f454ac4c in Status: SUCCESS [ 824.184020] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5497a3e0-53ac-4406-b988-4b00f454ac4c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.184020] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5497a3e0-53ac-4406-b988-4b00f454ac4c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.184020] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5497a3e0-53ac-4406-b988-4b00f454ac4c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.184020] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.184020] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.184020] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.184020] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.184020] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.184020] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5497a3e0-53ac-4406-b988-4b00f454ac4c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.184020] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5497a3e0-53ac-4406-b988-4b00f454ac4c',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.498275] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1b329aa6-2b06-4112-ad10-7c2ede9e4774 in Status: SUCCESS [ 824.498482] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1b329aa6-2b06-4112-ad10-7c2ede9e4774" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.685392] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-5497a3e0-53ac-4406-b988-4b00f454ac4c taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.685526] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5497a3e0-53ac-4406-b988-4b00f454ac4c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.685612] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5497a3e0-53ac-4406-b988-4b00f454ac4c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.685823] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5497a3e0-53ac-4406-b988-4b00f454ac4c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.685990] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.686095] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.686150] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.686299] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.686382] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.686465] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5497a3e0-53ac-4406-b988-4b00f454ac4c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.686611] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-5497a3e0-53ac-4406-b988-4b00f454ac4c taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.686718] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5497a3e0-53ac-4406-b988-4b00f454ac4c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.686925] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5497a3e0-53ac-4406-b988-4b00f454ac4c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.687090] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5497a3e0-53ac-4406-b988-4b00f454ac4c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.687228] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.687312] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.687364] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.687500] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.687575] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.687667] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5497a3e0-53ac-4406-b988-4b00f454ac4c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.687739] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5497a3e0-53ac-4406-b988-4b00f454ac4c',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.190869] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5497a3e0-53ac-4406-b988-4b00f454ac4c: rpc.has_security_group_logging(os_id): False [ 825.213664] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.213664] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.213864] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.214507] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.214507] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.214507] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.214815] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.214815] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.214938] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.215079] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.215956] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.216696] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.216696] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.216696] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.216696] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.217480] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.217480] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.217480] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.217480] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.217480] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.217480] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5497a3e0-53ac-4406-b988-4b00f454ac4c is going to be created. [ 825.287133] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.287301] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.287347] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.287568] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.287753] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.307041] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5497a3e0-53ac-4406-b988-4b00f454ac4c in Status: IN_PROGRESS for 2s [ 825.900195] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 825.900477] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 827.321927] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5497a3e0-53ac-4406-b988-4b00f454ac4c in Status: SUCCESS [ 827.322342] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5497a3e0-53ac-4406-b988-4b00f454ac4c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.646421] env[65065]: INFO networking_nsxv3.common.synchronization [None req-6b305a97-0ef9-4000-bc8d-ea65f29e79ed None None] Enqueued Resource ID: 1fd4fd97-6d8e-4d48-bf60-ff15d15749e6 with Priority: HIGHEST for action port [ 827.646421] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1fd4fd97-6d8e-4d48-bf60-ff15d15749e6 with Priority: HIGHEST for action port [ 827.646421] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-1fd4fd97-6d8e-4d48-bf60-ff15d15749e6 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.646421] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1fd4fd97-6d8e-4d48-bf60-ff15d15749e6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.646421] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1fd4fd97-6d8e-4d48-bf60-ff15d15749e6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.647903] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1fd4fd97-6d8e-4d48-bf60-ff15d15749e6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.649471] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1fd4fd97-6d8e-4d48-bf60-ff15d15749e6',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.150817] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1fd4fd97-6d8e-4d48-bf60-ff15d15749e6 [ 828.151222] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.151410] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.151410] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.151773] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.151892] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.152024] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1fd4fd97-6d8e-4d48-bf60-ff15d15749e6 already deleted. [ 828.152145] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1fd4fd97-6d8e-4d48-bf60-ff15d15749e6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.851100] env[65065]: INFO networking_nsxv3.common.synchronization [req-5f4656a3-afed-4dbf-9e8f-8e0ce97e5a13 req-bcf97d6b-b302-46e6-9d90-bc705be734c5 tempest-ImagesTestJSON-1714479415 tempest-ImagesTestJSON-1714479415-project-member] Enqueued Resource ID: e6d7baac-4bff-46b9-b88d-2dc982621c0f with Priority: HIGHEST for action security_group_members [ 828.852055] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6d7baac-4bff-46b9-b88d-2dc982621c0f with Priority: HIGHEST for action security_group_members [ 828.852851] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6d7baac-4bff-46b9-b88d-2dc982621c0f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.853055] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.853055] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.853311] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.853640] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.853640] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.853640] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.853856] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.853856] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.853980] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e6d7baac-4bff-46b9-b88d-2dc982621c0f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.285820] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock network-582 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.286050] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "network-582" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.286157] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "network-582" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.286485] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "network-582" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.286756] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.286907] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.287569] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.287858] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.288031] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.288265] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 829.288389] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 829.288499] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 829.288602] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 829.288740] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 829.288830] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 829.288961] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 829.315417] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 829.315618] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 829.315719] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 829.315901] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "network-582" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.316245] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock port-8c1dbab6-7dfe-423f-b7f4-7defc0ac4993 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.316397] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "port-8c1dbab6-7dfe-423f-b7f4-7defc0ac4993" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.316511] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "port-8c1dbab6-7dfe-423f-b7f4-7defc0ac4993" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.316886] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "port-8c1dbab6-7dfe-423f-b7f4-7defc0ac4993" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.317040] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8c1dbab6-7dfe-423f-b7f4-7defc0ac4993',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.356240] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e6d7baac-4bff-46b9-b88d-2dc982621c0f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.387389] env[65065]: INFO networking_nsxv3.common.synchronization [req-0113b7b6-d0b1-48d5-bf7a-7cbf34b1f381 req-3158c527-c5bb-47f2-9503-16f4e81c40fd tempest-SecurityGroupsTestJSON-312946932 tempest-SecurityGroupsTestJSON-312946932-project-member] Enqueued Resource ID: c16acdbe-d600-40de-b3d9-384201f1e513 with Priority: HIGHEST for action security_group_members [ 829.387612] env[65065]: INFO networking_nsxv3.common.synchronization [req-0113b7b6-d0b1-48d5-bf7a-7cbf34b1f381 req-3158c527-c5bb-47f2-9503-16f4e81c40fd tempest-SecurityGroupsTestJSON-312946932 tempest-SecurityGroupsTestJSON-312946932-project-member] Enqueued Resource ID: f3805be6-3069-4624-897e-f4bf1dc6cd31 with Priority: HIGHEST for action security_group_members [ 829.387787] env[65065]: INFO networking_nsxv3.common.synchronization [req-0113b7b6-d0b1-48d5-bf7a-7cbf34b1f381 req-3158c527-c5bb-47f2-9503-16f4e81c40fd tempest-SecurityGroupsTestJSON-312946932 tempest-SecurityGroupsTestJSON-312946932-project-member] Enqueued Resource ID: 99423afc-7fd3-4e3d-8a84-f190e0af048f with Priority: HIGHEST for action security_group_members [ 829.388389] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c16acdbe-d600-40de-b3d9-384201f1e513 with Priority: HIGHEST for action security_group_members [ 829.388558] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3805be6-3069-4624-897e-f4bf1dc6cd31 with Priority: HIGHEST for action security_group_members [ 829.388681] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99423afc-7fd3-4e3d-8a84-f190e0af048f with Priority: HIGHEST for action security_group_members [ 829.389046] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-c16acdbe-d600-40de-b3d9-384201f1e513 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.389204] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c16acdbe-d600-40de-b3d9-384201f1e513" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.389302] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c16acdbe-d600-40de-b3d9-384201f1e513" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.389553] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c16acdbe-d600-40de-b3d9-384201f1e513" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.389759] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.389889] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.389973] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.390173] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.390282] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.390409] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c16acdbe-d600-40de-b3d9-384201f1e513',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.391510] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3805be6-3069-4624-897e-f4bf1dc6cd31 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.391607] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3805be6-3069-4624-897e-f4bf1dc6cd31" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.391689] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3805be6-3069-4624-897e-f4bf1dc6cd31" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.391871] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3805be6-3069-4624-897e-f4bf1dc6cd31" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.393110] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.393110] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.393110] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.393110] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.393110] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.393110] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3805be6-3069-4624-897e-f4bf1dc6cd31',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.394927] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-99423afc-7fd3-4e3d-8a84-f190e0af048f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.395114] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.395198] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.395399] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.395998] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.396190] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.396310] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.396469] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.396563] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.396677] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('99423afc-7fd3-4e3d-8a84-f190e0af048f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.820021] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.820380] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.820503] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.820839] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.821035] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.821228] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Segment Port 8c1dbab6-7dfe-423f-b7f4-7defc0ac4993 not found, creating... [ 829.821539] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.821732] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.821872] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.822207] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.822287] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.822624] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.822803] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.822933] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.823201] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.823359] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.823528] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Resource: SegmentPort with ID: 8c1dbab6-7dfe-423f-b7f4-7defc0ac4993 is going to be created. [ 829.845241] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.845804] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.845944] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.846277] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.846725] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.847283] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "port-8c1dbab6-7dfe-423f-b7f4-7defc0ac4993" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.860495] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e6d7baac-4bff-46b9-b88d-2dc982621c0f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.896267] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.896267] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.896267] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.896267] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.899162] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.899274] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.899528] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.900148] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.920716] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.920716] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.920716] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.920716] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.920716] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.920716] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.920716] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3805be6-3069-4624-897e-f4bf1dc6cd31 is going to be updated. [ 829.920716] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.920716] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.960218] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.960779] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.960779] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.960779] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.961016] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.961016] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.961115] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99423afc-7fd3-4e3d-8a84-f190e0af048f is going to be updated. [ 829.962594] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.962854] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.962948] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.963168] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.963284] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.963345] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.963523] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.963623] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.963719] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c16acdbe-d600-40de-b3d9-384201f1e513 is going to be updated. [ 829.995522] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.995778] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.995778] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.996014] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.996096] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.011941] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3805be6-3069-4624-897e-f4bf1dc6cd31 in Status: IN_PROGRESS for 2s [ 830.014603] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.014759] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.014815] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.015131] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.015308] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.017302] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.017423] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.017527] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.017763] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.017941] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.029013] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c16acdbe-d600-40de-b3d9-384201f1e513 in Status: IN_PROGRESS for 2s [ 830.029714] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99423afc-7fd3-4e3d-8a84-f190e0af048f in Status: IN_PROGRESS for 2s [ 830.363643] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.363828] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.363891] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.364345] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.364426] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.364620] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6d7baac-4bff-46b9-b88d-2dc982621c0f is going to be updated. [ 830.395492] env[65065]: INFO networking_nsxv3.common.synchronization [None req-b847575e-166c-4aaa-887c-e2ebefc0a441 None None] Enqueued Resource ID: b1874f38-f500-4c7a-b3f8-5514a94a537e with Priority: HIGHEST for action port [ 830.396041] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1874f38-f500-4c7a-b3f8-5514a94a537e with Priority: HIGHEST for action port [ 830.396357] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-b1874f38-f500-4c7a-b3f8-5514a94a537e taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.396480] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b1874f38-f500-4c7a-b3f8-5514a94a537e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.396547] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b1874f38-f500-4c7a-b3f8-5514a94a537e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.396858] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b1874f38-f500-4c7a-b3f8-5514a94a537e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.396956] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b1874f38-f500-4c7a-b3f8-5514a94a537e',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.398536] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.398658] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.398925] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.399020] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.399237] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.410384] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6d7baac-4bff-46b9-b88d-2dc982621c0f in Status: IN_PROGRESS for 2s [ 830.585591] env[65065]: INFO networking_nsxv3.common.synchronization [req-5f4656a3-afed-4dbf-9e8f-8e0ce97e5a13 req-24bbb794-d967-4574-be37-26394045a6c6 service nova] Enqueued Resource ID: e6d7baac-4bff-46b9-b88d-2dc982621c0f with Priority: HIGHEST for action security_group_rules [ 830.585965] env[65065]: INFO networking_nsxv3.common.synchronization [req-5f4656a3-afed-4dbf-9e8f-8e0ce97e5a13 req-24bbb794-d967-4574-be37-26394045a6c6 service nova] Enqueued Resource ID: e6d7baac-4bff-46b9-b88d-2dc982621c0f with Priority: HIGHEST for action security_group_members [ 830.586820] env[65065]: INFO networking_nsxv3.common.synchronization [req-5f4656a3-afed-4dbf-9e8f-8e0ce97e5a13 req-24bbb794-d967-4574-be37-26394045a6c6 service nova] Enqueued Resource ID: 8c1dbab6-7dfe-423f-b7f4-7defc0ac4993 with Priority: HIGHEST for action port [ 830.586969] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6d7baac-4bff-46b9-b88d-2dc982621c0f with Priority: HIGHEST for action security_group_rules [ 830.587033] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6d7baac-4bff-46b9-b88d-2dc982621c0f with Priority: HIGHEST for action security_group_members [ 830.587188] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c1dbab6-7dfe-423f-b7f4-7defc0ac4993 with Priority: HIGHEST for action port [ 830.587505] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e6d7baac-4bff-46b9-b88d-2dc982621c0f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.587680] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.587783] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.588252] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.588252] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e6d7baac-4bff-46b9-b88d-2dc982621c0f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.589282] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6d7baac-4bff-46b9-b88d-2dc982621c0f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.589282] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.590066] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-8c1dbab6-7dfe-423f-b7f4-7defc0ac4993 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.590066] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8c1dbab6-7dfe-423f-b7f4-7defc0ac4993" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.590066] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8c1dbab6-7dfe-423f-b7f4-7defc0ac4993" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.590066] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8c1dbab6-7dfe-423f-b7f4-7defc0ac4993" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.590247] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8c1dbab6-7dfe-423f-b7f4-7defc0ac4993',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.902279] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b1874f38-f500-4c7a-b3f8-5514a94a537e [ 830.902633] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.905025] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.905025] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.905025] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.905025] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.905025] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b1874f38-f500-4c7a-b3f8-5514a94a537e already deleted. [ 830.905025] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b1874f38-f500-4c7a-b3f8-5514a94a537e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.094350] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6d7baac-4bff-46b9-b88d-2dc982621c0f taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.094350] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.094350] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8c1dbab6-7dfe-423f-b7f4-7defc0ac4993 with status ACTIVE [ 831.094350] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.094350] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.094350] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.094350] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.094350] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.094350] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.094350] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.095639] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.095639] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.095639] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.095639] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.095639] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.096598] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.096598] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.096598] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.096598] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8c1dbab6-7dfe-423f-b7f4-7defc0ac4993 is going to be updated. [ 831.120801] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.120994] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.121085] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.121293] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.121432] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.121598] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8c1dbab6-7dfe-423f-b7f4-7defc0ac4993" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.023976] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3805be6-3069-4624-897e-f4bf1dc6cd31 in Status: SUCCESS [ 832.024323] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3805be6-3069-4624-897e-f4bf1dc6cd31 deletion is rescheduled due to dependency. [ 832.024323] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3805be6-3069-4624-897e-f4bf1dc6cd31" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.040453] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c16acdbe-d600-40de-b3d9-384201f1e513 in Status: SUCCESS [ 832.040566] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c16acdbe-d600-40de-b3d9-384201f1e513 deletion is rescheduled due to dependency. [ 832.040729] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c16acdbe-d600-40de-b3d9-384201f1e513" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.042539] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99423afc-7fd3-4e3d-8a84-f190e0af048f in Status: SUCCESS [ 832.042539] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99423afc-7fd3-4e3d-8a84-f190e0af048f deletion is rescheduled due to dependency. [ 832.042539] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.442920] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6d7baac-4bff-46b9-b88d-2dc982621c0f in Status: SUCCESS [ 832.442920] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.443152] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.443257] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.443446] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.443563] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.443626] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.443771] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.443855] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.443980] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e6d7baac-4bff-46b9-b88d-2dc982621c0f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.949853] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e6d7baac-4bff-46b9-b88d-2dc982621c0f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.455334] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e6d7baac-4bff-46b9-b88d-2dc982621c0f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.958879] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.959122] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.959177] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.960301] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.960301] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.960301] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6d7baac-4bff-46b9-b88d-2dc982621c0f is going to be updated. [ 833.997684] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.997851] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.997900] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.998799] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.998799] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.010654] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6d7baac-4bff-46b9-b88d-2dc982621c0f in Status: IN_PROGRESS for 2s [ 834.594181] env[65065]: INFO networking_nsxv3.common.synchronization [req-b3a01106-7cd3-4fba-9b5a-964e49f0b1fc req-0b1278fa-f642-474f-804c-6af79a58afd2 tempest-InstanceActionsV221TestJSON-1734092346 tempest-InstanceActionsV221TestJSON-1734092346-project-member] Enqueued Resource ID: 5497a3e0-53ac-4406-b988-4b00f454ac4c with Priority: HIGHEST for action security_group_members [ 834.594775] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5497a3e0-53ac-4406-b988-4b00f454ac4c with Priority: HIGHEST for action security_group_members [ 834.595687] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-5497a3e0-53ac-4406-b988-4b00f454ac4c taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.595687] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5497a3e0-53ac-4406-b988-4b00f454ac4c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.595874] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5497a3e0-53ac-4406-b988-4b00f454ac4c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.595911] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5497a3e0-53ac-4406-b988-4b00f454ac4c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.596095] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.596199] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.596423] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.596423] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.596520] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.596591] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5497a3e0-53ac-4406-b988-4b00f454ac4c',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.827937] env[65065]: INFO networking_nsxv3.common.synchronization [req-6b1d88a6-783e-4f64-bd90-24790b5aaf70 req-23c29aff-3f3d-4ffc-af81-6a0da19bccd0 tempest-ServersAdminTestJSON-1746807080 tempest-ServersAdminTestJSON-1746807080-project-member] Enqueued Resource ID: ed4053b7-493c-48f8-b82e-b002cbcc3a61 with Priority: HIGHEST for action security_group_members [ 834.828660] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed4053b7-493c-48f8-b82e-b002cbcc3a61 with Priority: HIGHEST for action security_group_members [ 834.828839] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed4053b7-493c-48f8-b82e-b002cbcc3a61 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.828972] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.829197] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.830158] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.830377] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.830535] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.830635] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.831442] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.832033] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.832033] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ed4053b7-493c-48f8-b82e-b002cbcc3a61',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.100618] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.100618] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.100618] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.100618] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.100618] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.100618] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.100618] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.100618] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.100618] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.100618] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.100618] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5497a3e0-53ac-4406-b988-4b00f454ac4c is going to be updated. [ 835.135019] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.135232] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.135232] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.136940] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.136940] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.144295] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5497a3e0-53ac-4406-b988-4b00f454ac4c in Status: IN_PROGRESS for 2s [ 835.338259] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ed4053b7-493c-48f8-b82e-b002cbcc3a61',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.839747] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ed4053b7-493c-48f8-b82e-b002cbcc3a61',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.021424] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6d7baac-4bff-46b9-b88d-2dc982621c0f in Status: SUCCESS [ 836.021669] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.021855] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.022240] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.022469] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.022605] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.022697] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.022866] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.022970] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.023078] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.023195] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e6d7baac-4bff-46b9-b88d-2dc982621c0f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.175487] env[65065]: INFO networking_nsxv3.common.synchronization [req-32073e53-8be5-4d5f-af3d-86452bd82e11 req-b81ebf1f-d2f7-451a-a5e4-74c2c43557fe tempest-DeleteServersTestJSON-1316666736 tempest-DeleteServersTestJSON-1316666736-project-member] Enqueued Resource ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 with Priority: HIGHEST for action security_group_members [ 836.176209] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 with Priority: HIGHEST for action security_group_members [ 836.176628] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d0941d4-57d8-45e9-9f2f-95128b8136e5 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.176837] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.176912] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.177158] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.177320] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.177419] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.177504] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.178104] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.178104] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.178104] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d0941d4-57d8-45e9-9f2f-95128b8136e5',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.343297] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.343297] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.343297] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.343297] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.343297] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.343297] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ed4053b7-493c-48f8-b82e-b002cbcc3a61 is going to be updated. [ 836.390192] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.390707] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.390707] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.390707] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.390707] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.400888] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed4053b7-493c-48f8-b82e-b002cbcc3a61 in Status: IN_PROGRESS for 2s [ 836.526409] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6d7baac-4bff-46b9-b88d-2dc982621c0f taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.526646] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.526646] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.527886] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.527886] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.527886] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.527886] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.527886] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.527886] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.527886] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.527886] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6d7baac-4bff-46b9-b88d-2dc982621c0f taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.527886] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.527886] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.528653] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.528653] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.528653] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.528653] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.528653] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.528653] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.528653] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.529091] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e6d7baac-4bff-46b9-b88d-2dc982621c0f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.592358] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock network-950 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.592653] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "network-950" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.592813] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "network-950" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.593106] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "network-950" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.593892] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.594166] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.594386] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.594729] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.595165] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.595493] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 836.595627] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 836.595794] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 836.595942] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 836.597997] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 836.597997] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 836.597997] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 836.618605] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 836.618810] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 836.619014] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 836.619244] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "network-950" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.619635] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock port-7530b0d7-6d82-4b9a-a824-9f4586231321 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.619849] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "port-7530b0d7-6d82-4b9a-a824-9f4586231321" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.620130] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "port-7530b0d7-6d82-4b9a-a824-9f4586231321" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.620710] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "port-7530b0d7-6d82-4b9a-a824-9f4586231321" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.620710] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7530b0d7-6d82-4b9a-a824-9f4586231321',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.680570] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.680789] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.680873] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.681228] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.709447] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.709447] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.709447] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.709447] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.709810] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.710781] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.710781] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 is going to be updated. [ 836.741571] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.741917] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.743215] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.743215] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.743215] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.755263] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 in Status: IN_PROGRESS for 2s [ 837.031676] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e6d7baac-4bff-46b9-b88d-2dc982621c0f: rpc.has_security_group_logging(os_id): False [ 837.052571] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.052821] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.052821] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.053037] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.053145] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.053372] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.053475] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.053636] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.053818] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.053901] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.054149] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.054259] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.054337] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.054518] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.054620] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.054927] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.055043] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.055114] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.055303] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.055385] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.055474] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e6d7baac-4bff-46b9-b88d-2dc982621c0f is going to be updated. [ 837.122500] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.122693] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.122802] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.123191] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.123436] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.125179] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.125405] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.125555] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.125816] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.125982] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.126149] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Segment Port 7530b0d7-6d82-4b9a-a824-9f4586231321 not found, creating... [ 837.126411] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.126590] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.127364] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.127364] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.127364] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.127738] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.127738] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.127738] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.127940] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.128225] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.128371] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Resource: SegmentPort with ID: 7530b0d7-6d82-4b9a-a824-9f4586231321 is going to be created. [ 837.156611] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5497a3e0-53ac-4406-b988-4b00f454ac4c in Status: SUCCESS [ 837.156694] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5497a3e0-53ac-4406-b988-4b00f454ac4c deletion is rescheduled due to dependency. [ 837.156885] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5497a3e0-53ac-4406-b988-4b00f454ac4c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.162139] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e6d7baac-4bff-46b9-b88d-2dc982621c0f in Status: IN_PROGRESS for 2s [ 837.173164] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.173406] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.173529] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.173828] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.174081] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.174339] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "port-7530b0d7-6d82-4b9a-a824-9f4586231321" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.963878] env[65065]: INFO networking_nsxv3.common.synchronization [req-32073e53-8be5-4d5f-af3d-86452bd82e11 req-b4cfb8c7-4bac-4caf-9e6d-906baaa0ec78 service nova] Enqueued Resource ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 with Priority: HIGHEST for action security_group_rules [ 837.964105] env[65065]: INFO networking_nsxv3.common.synchronization [req-32073e53-8be5-4d5f-af3d-86452bd82e11 req-b4cfb8c7-4bac-4caf-9e6d-906baaa0ec78 service nova] Enqueued Resource ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 with Priority: HIGHEST for action security_group_members [ 837.964388] env[65065]: INFO networking_nsxv3.common.synchronization [req-32073e53-8be5-4d5f-af3d-86452bd82e11 req-b4cfb8c7-4bac-4caf-9e6d-906baaa0ec78 service nova] Enqueued Resource ID: 7530b0d7-6d82-4b9a-a824-9f4586231321 with Priority: HIGHEST for action port [ 837.964894] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 with Priority: HIGHEST for action security_group_rules [ 837.965268] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 with Priority: HIGHEST for action security_group_members [ 837.965398] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7530b0d7-6d82-4b9a-a824-9f4586231321 with Priority: HIGHEST for action port [ 837.965698] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7d0941d4-57d8-45e9-9f2f-95128b8136e5 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.966046] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.966046] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.966273] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.966273] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7d0941d4-57d8-45e9-9f2f-95128b8136e5',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.967906] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d0941d4-57d8-45e9-9f2f-95128b8136e5 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.968098] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.968337] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-7530b0d7-6d82-4b9a-a824-9f4586231321 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.968482] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7530b0d7-6d82-4b9a-a824-9f4586231321" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.968545] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7530b0d7-6d82-4b9a-a824-9f4586231321" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.968691] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7530b0d7-6d82-4b9a-a824-9f4586231321" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.969403] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7530b0d7-6d82-4b9a-a824-9f4586231321',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.414830] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed4053b7-493c-48f8-b82e-b002cbcc3a61 in Status: SUCCESS [ 838.415175] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.468955] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d0941d4-57d8-45e9-9f2f-95128b8136e5 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.469234] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.475790] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7530b0d7-6d82-4b9a-a824-9f4586231321 with status ACTIVE [ 838.476127] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.476309] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.476416] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.476709] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.476864] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.477106] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.477296] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.477355] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.477555] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.477668] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.477915] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.478060] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.478125] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.478311] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.478411] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.478555] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7530b0d7-6d82-4b9a-a824-9f4586231321 is going to be updated. [ 838.505648] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.505648] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.505648] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.505960] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.505960] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.506164] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7530b0d7-6d82-4b9a-a824-9f4586231321" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.766885] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 in Status: SUCCESS [ 838.767103] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 deletion is rescheduled due to dependency. [ 838.767234] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.767501] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.767574] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.767716] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.767829] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.767883] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.768051] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.768134] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.768219] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d0941d4-57d8-45e9-9f2f-95128b8136e5',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.938038] env[65065]: INFO networking_nsxv3.common.synchronization [req-a2d67ca1-da90-43e0-834c-2ca8aefd6d10 req-cc536b83-6bbc-4cb9-beab-82dd02aa1f93 tempest-FloatingIPsAssociationTestJSON-1239844979 tempest-FloatingIPsAssociationTestJSON-1239844979-project-member] Enqueued Resource ID: a7006bfc-4bfa-49da-a51e-6cc26b8098c3 with Priority: HIGHEST for action security_group_members [ 838.938366] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7006bfc-4bfa-49da-a51e-6cc26b8098c3 with Priority: HIGHEST for action security_group_members [ 838.938691] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7006bfc-4bfa-49da-a51e-6cc26b8098c3 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.938909] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7006bfc-4bfa-49da-a51e-6cc26b8098c3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.938909] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7006bfc-4bfa-49da-a51e-6cc26b8098c3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.939280] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7006bfc-4bfa-49da-a51e-6cc26b8098c3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.939280] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.939442] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.939442] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.939638] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.939638] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.939794] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a7006bfc-4bfa-49da-a51e-6cc26b8098c3',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.967976] env[65065]: INFO networking_nsxv3.common.synchronization [req-3d92fe01-0e8c-45f9-9931-2e7666c84126 req-b6c56143-70c3-4aab-b678-1c806d94b846 tempest-ServerMetadataTestJSON-643522844 tempest-ServerMetadataTestJSON-643522844-project-member] Enqueued Resource ID: 1b329aa6-2b06-4112-ad10-7c2ede9e4774 with Priority: HIGHEST for action security_group_members [ 838.968493] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b329aa6-2b06-4112-ad10-7c2ede9e4774 with Priority: HIGHEST for action security_group_members [ 838.968854] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b329aa6-2b06-4112-ad10-7c2ede9e4774 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.968983] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b329aa6-2b06-4112-ad10-7c2ede9e4774" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.969937] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b329aa6-2b06-4112-ad10-7c2ede9e4774" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.970160] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b329aa6-2b06-4112-ad10-7c2ede9e4774" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.970324] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.970431] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.970495] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.970645] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.970727] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.970821] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1b329aa6-2b06-4112-ad10-7c2ede9e4774',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.179174] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e6d7baac-4bff-46b9-b88d-2dc982621c0f in Status: SUCCESS [ 839.179174] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.273508] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7d0941d4-57d8-45e9-9f2f-95128b8136e5',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.443980] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.443980] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.443980] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.443980] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.443980] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.443980] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.443980] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.443980] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.443980] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.443980] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.443980] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a7006bfc-4bfa-49da-a51e-6cc26b8098c3 is going to be updated. [ 839.474866] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.475165] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.475286] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.475573] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.475737] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.475991] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.476158] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.476227] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.476539] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.476539] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.476752] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1b329aa6-2b06-4112-ad10-7c2ede9e4774 is going to be updated. [ 839.508105] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.508257] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.508355] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.508641] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.508885] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.524957] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7006bfc-4bfa-49da-a51e-6cc26b8098c3 in Status: IN_PROGRESS for 2s [ 839.533494] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.533494] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.533494] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.533839] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.533839] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.545759] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1b329aa6-2b06-4112-ad10-7c2ede9e4774 in Status: IN_PROGRESS for 2s [ 839.775981] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7d0941d4-57d8-45e9-9f2f-95128b8136e5',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.283593] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.283593] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.283593] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.283593] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.283593] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.283593] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 is going to be updated. [ 840.318131] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.318315] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.318388] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.318554] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.318690] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.329250] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 in Status: IN_PROGRESS for 2s [ 841.005468] env[65065]: INFO networking_nsxv3.common.synchronization [req-e5296e76-9066-4cd6-822d-b47908b44742 req-602e8779-9e80-43a1-88df-0c8f19eaed29 tempest-ServerAddressesNegativeTestJSON-74501713 tempest-ServerAddressesNegativeTestJSON-74501713-project-member] Enqueued Resource ID: ea7028db-7886-4f7f-a360-7b19a81fd53e with Priority: HIGHEST for action security_group_members [ 841.005468] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea7028db-7886-4f7f-a360-7b19a81fd53e with Priority: HIGHEST for action security_group_members [ 841.005468] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea7028db-7886-4f7f-a360-7b19a81fd53e taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.005468] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea7028db-7886-4f7f-a360-7b19a81fd53e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.005468] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea7028db-7886-4f7f-a360-7b19a81fd53e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.005468] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea7028db-7886-4f7f-a360-7b19a81fd53e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.006348] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.006348] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.006348] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.006348] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.006348] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.006550] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ea7028db-7886-4f7f-a360-7b19a81fd53e',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.431917] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock network-673 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.432355] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "network-673" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.432465] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "network-673" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.435852] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "network-673" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.436201] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.436377] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.436524] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.436764] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.436909] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.437126] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 841.437239] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 841.437550] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 841.437736] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 841.437897] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 841.438070] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 841.438831] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 841.462671] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 841.462671] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 841.462671] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 841.462671] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "network-673" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.463132] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock port-6459a58d-938c-4a36-b3da-9fd971c29d1c taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.463219] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "port-6459a58d-938c-4a36-b3da-9fd971c29d1c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.467328] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "port-6459a58d-938c-4a36-b3da-9fd971c29d1c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.467328] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "port-6459a58d-938c-4a36-b3da-9fd971c29d1c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.467328] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6459a58d-938c-4a36-b3da-9fd971c29d1c',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.509898] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.510387] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.510387] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.511868] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.511868] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.511868] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.511868] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.511868] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.511868] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.511868] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.511868] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ea7028db-7886-4f7f-a360-7b19a81fd53e already deleted. [ 841.511868] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea7028db-7886-4f7f-a360-7b19a81fd53e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.541375] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7006bfc-4bfa-49da-a51e-6cc26b8098c3 in Status: SUCCESS [ 841.541375] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a7006bfc-4bfa-49da-a51e-6cc26b8098c3 deletion is rescheduled due to dependency. [ 841.541375] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7006bfc-4bfa-49da-a51e-6cc26b8098c3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.561523] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1b329aa6-2b06-4112-ad10-7c2ede9e4774 in Status: SUCCESS [ 841.561776] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1b329aa6-2b06-4112-ad10-7c2ede9e4774 deletion is rescheduled due to dependency. [ 841.561952] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b329aa6-2b06-4112-ad10-7c2ede9e4774" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.969170] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.969442] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.969583] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.969977] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.970170] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.970300] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Segment Port 6459a58d-938c-4a36-b3da-9fd971c29d1c not found, creating... [ 841.970622] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.970808] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.970959] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.971255] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.971429] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.971798] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.971949] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.972110] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.972373] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.972514] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.972685] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Resource: SegmentPort with ID: 6459a58d-938c-4a36-b3da-9fd971c29d1c is going to be created. [ 842.000362] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.000872] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.000872] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.001223] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.001559] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.001924] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "port-6459a58d-938c-4a36-b3da-9fd971c29d1c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.345180] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 in Status: SUCCESS [ 842.345573] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.345689] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.345936] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.346146] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.346267] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.346332] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.346487] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.346569] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.346658] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.346791] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7d0941d4-57d8-45e9-9f2f-95128b8136e5',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.758417] env[65065]: INFO networking_nsxv3.common.synchronization [req-e5296e76-9066-4cd6-822d-b47908b44742 req-dd204e3c-ae7c-45b4-b4b9-885a8a566ccf service nova] Enqueued Resource ID: ea7028db-7886-4f7f-a360-7b19a81fd53e with Priority: HIGHEST for action security_group_rules [ 842.758593] env[65065]: INFO networking_nsxv3.common.synchronization [req-e5296e76-9066-4cd6-822d-b47908b44742 req-dd204e3c-ae7c-45b4-b4b9-885a8a566ccf service nova] Enqueued Resource ID: ea7028db-7886-4f7f-a360-7b19a81fd53e with Priority: HIGHEST for action security_group_members [ 842.758726] env[65065]: INFO networking_nsxv3.common.synchronization [req-e5296e76-9066-4cd6-822d-b47908b44742 req-dd204e3c-ae7c-45b4-b4b9-885a8a566ccf service nova] Enqueued Resource ID: 6459a58d-938c-4a36-b3da-9fd971c29d1c with Priority: HIGHEST for action port [ 842.759401] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea7028db-7886-4f7f-a360-7b19a81fd53e with Priority: HIGHEST for action security_group_rules [ 842.759555] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea7028db-7886-4f7f-a360-7b19a81fd53e with Priority: HIGHEST for action security_group_members [ 842.759651] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6459a58d-938c-4a36-b3da-9fd971c29d1c with Priority: HIGHEST for action port [ 842.759973] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ea7028db-7886-4f7f-a360-7b19a81fd53e taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.760946] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ea7028db-7886-4f7f-a360-7b19a81fd53e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.761082] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ea7028db-7886-4f7f-a360-7b19a81fd53e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.761319] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ea7028db-7886-4f7f-a360-7b19a81fd53e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.761490] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ea7028db-7886-4f7f-a360-7b19a81fd53e',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.762454] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea7028db-7886-4f7f-a360-7b19a81fd53e taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.762574] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea7028db-7886-4f7f-a360-7b19a81fd53e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.762640] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea7028db-7886-4f7f-a360-7b19a81fd53e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.762825] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea7028db-7886-4f7f-a360-7b19a81fd53e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.762983] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.763094] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.763149] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.763286] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.763368] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.763462] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ea7028db-7886-4f7f-a360-7b19a81fd53e',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.764312] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-6459a58d-938c-4a36-b3da-9fd971c29d1c taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.764418] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6459a58d-938c-4a36-b3da-9fd971c29d1c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.764476] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6459a58d-938c-4a36-b3da-9fd971c29d1c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.764625] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6459a58d-938c-4a36-b3da-9fd971c29d1c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.764714] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6459a58d-938c-4a36-b3da-9fd971c29d1c',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.849523] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d0941d4-57d8-45e9-9f2f-95128b8136e5 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.849696] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.849808] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.850044] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.850244] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.850374] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.850439] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.850629] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.850755] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.850880] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.851277] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d0941d4-57d8-45e9-9f2f-95128b8136e5 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.851277] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.851370] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.851528] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.851678] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.851789] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.851885] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.852107] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.852232] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.852419] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.852555] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7d0941d4-57d8-45e9-9f2f-95128b8136e5',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.266749] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea7028db-7886-4f7f-a360-7b19a81fd53e taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.266940] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea7028db-7886-4f7f-a360-7b19a81fd53e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.267125] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ea7028db-7886-4f7f-a360-7b19a81fd53e',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.268038] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6459a58d-938c-4a36-b3da-9fd971c29d1c with status ACTIVE [ 843.268552] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.268552] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.268552] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.268740] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.268740] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.268930] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.269043] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.269138] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.269303] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.269383] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.269565] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.269660] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.269716] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.269865] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.269995] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.270085] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6459a58d-938c-4a36-b3da-9fd971c29d1c is going to be updated. [ 843.298964] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.299144] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.299213] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.299437] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.299592] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.299776] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6459a58d-938c-4a36-b3da-9fd971c29d1c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.356082] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7d0941d4-57d8-45e9-9f2f-95128b8136e5: rpc.has_security_group_logging(os_id): False [ 843.396649] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.396985] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.397095] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.397356] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.397455] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.397924] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.397924] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.398122] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.398316] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.398413] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.398650] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.398790] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.398924] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.399148] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.399232] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.399445] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.399547] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.399624] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.399849] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.400177] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.400177] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 is going to be updated. [ 843.501913] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.501913] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.502204] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.502921] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.502921] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.523510] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 in Status: IN_PROGRESS for 2s [ 843.675160] env[65065]: INFO networking_nsxv3.common.synchronization [req-3b72bb9b-85f3-4366-b6cf-e81e02ca0624 req-7a37224e-bc4a-492f-9678-76d8d4af8f54 tempest-VolumesAssistedSnapshotsTest-1337089844 tempest-VolumesAssistedSnapshotsTest-1337089844-project-member] Enqueued Resource ID: d38273aa-e7d2-4aea-bcb1-2f5ae899e71f with Priority: HIGHEST for action security_group_members [ 843.675747] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d38273aa-e7d2-4aea-bcb1-2f5ae899e71f with Priority: HIGHEST for action security_group_members [ 843.676165] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-d38273aa-e7d2-4aea-bcb1-2f5ae899e71f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.676330] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d38273aa-e7d2-4aea-bcb1-2f5ae899e71f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.677075] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d38273aa-e7d2-4aea-bcb1-2f5ae899e71f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.677075] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d38273aa-e7d2-4aea-bcb1-2f5ae899e71f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.677450] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.677710] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.677710] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.677947] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.678094] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.678238] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d38273aa-e7d2-4aea-bcb1-2f5ae899e71f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.773767] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ea7028db-7886-4f7f-a360-7b19a81fd53e',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.898214] env[65065]: INFO networking_nsxv3.common.synchronization [req-07d15923-b711-4181-bcc5-7a7e3dbd9872 req-27656d6b-6f25-42ac-ba66-f1267eb6978b tempest-ServersNegativeTestJSON-1748204548 tempest-ServersNegativeTestJSON-1748204548-project-member] Enqueued Resource ID: a793cfdd-5070-4bec-85b3-ff10a26c966f with Priority: HIGHEST for action security_group_members [ 843.898214] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a793cfdd-5070-4bec-85b3-ff10a26c966f with Priority: HIGHEST for action security_group_members [ 843.898214] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-a793cfdd-5070-4bec-85b3-ff10a26c966f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.898214] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a793cfdd-5070-4bec-85b3-ff10a26c966f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.898214] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a793cfdd-5070-4bec-85b3-ff10a26c966f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.898214] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a793cfdd-5070-4bec-85b3-ff10a26c966f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.898453] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.898453] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.898538] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.899229] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.899229] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.899229] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a793cfdd-5070-4bec-85b3-ff10a26c966f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.169446] env[65065]: INFO networking_nsxv3.common.synchronization [req-321f386a-b3e1-4b28-b5fa-66756da01b9d req-d4b28237-0a77-4642-b3a4-ad38e5931a5f tempest-ImagesOneServerNegativeTestJSON-764093247 tempest-ImagesOneServerNegativeTestJSON-764093247-project-member] Enqueued Resource ID: 9ed22036-e9a4-4639-89b9-c743ca686b09 with Priority: HIGHEST for action security_group_members [ 844.171069] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ed22036-e9a4-4639-89b9-c743ca686b09 with Priority: HIGHEST for action security_group_members [ 844.171485] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ed22036-e9a4-4639-89b9-c743ca686b09 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.173250] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ed22036-e9a4-4639-89b9-c743ca686b09" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.173250] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ed22036-e9a4-4639-89b9-c743ca686b09" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.173250] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ed22036-e9a4-4639-89b9-c743ca686b09" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.173250] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.173250] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.173250] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.173250] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.173250] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.173250] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ed22036-e9a4-4639-89b9-c743ca686b09',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.181218] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.181218] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.181218] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.181218] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.181218] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.181218] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.182134] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.182134] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.182134] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.182134] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.182134] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d38273aa-e7d2-4aea-bcb1-2f5ae899e71f is going to be updated. [ 844.213040] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.213218] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.213304] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.213556] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.213734] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.224204] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d38273aa-e7d2-4aea-bcb1-2f5ae899e71f in Status: IN_PROGRESS for 2s [ 844.276370] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.276521] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.276582] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.276811] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.276920] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.278140] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ea7028db-7886-4f7f-a360-7b19a81fd53e is going to be created. [ 844.306480] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.306785] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.306785] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.306942] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.307115] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.319044] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea7028db-7886-4f7f-a360-7b19a81fd53e in Status: UNINITIALIZED for 2s [ 844.389783] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock network-887 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.390176] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "network-887" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.390233] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "network-887" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.390551] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "network-887" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.390857] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.391678] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.391784] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.391957] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.392154] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.392753] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 844.392753] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 844.392753] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 844.392753] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 844.393280] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 844.393280] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 844.393280] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 844.404929] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a793cfdd-5070-4bec-85b3-ff10a26c966f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.414355] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 844.414567] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 844.414791] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 844.415423] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "network-887" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.415471] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock port-2c2ab7cd-cf66-4a7c-b009-42cab2c8d225 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.415716] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "port-2c2ab7cd-cf66-4a7c-b009-42cab2c8d225" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.415876] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "port-2c2ab7cd-cf66-4a7c-b009-42cab2c8d225" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.416346] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "port-2c2ab7cd-cf66-4a7c-b009-42cab2c8d225" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.416538] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c2ab7cd-cf66-4a7c-b009-42cab2c8d225',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.680730] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.680730] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.680730] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.680730] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.680730] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.680730] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.681066] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.681066] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.681187] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.681231] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.681363] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ed22036-e9a4-4639-89b9-c743ca686b09 is going to be updated. [ 844.712014] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.712014] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.712014] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.712014] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.712014] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.722417] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ed22036-e9a4-4639-89b9-c743ca686b09 in Status: IN_PROGRESS for 2s [ 844.910164] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a793cfdd-5070-4bec-85b3-ff10a26c966f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.919708] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.920033] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.920181] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.920472] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.920620] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.920775] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Segment Port 2c2ab7cd-cf66-4a7c-b009-42cab2c8d225 not found, creating... [ 844.921057] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.921256] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.921433] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.921682] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.921823] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.923874] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.923874] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.923874] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.924114] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.924289] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.924443] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Resource: SegmentPort with ID: 2c2ab7cd-cf66-4a7c-b009-42cab2c8d225 is going to be created. [ 844.951407] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.951407] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.951407] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.951407] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.951407] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.951407] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "port-2c2ab7cd-cf66-4a7c-b009-42cab2c8d225" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.413597] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.413903] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.413903] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.414442] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.414442] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.414618] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a793cfdd-5070-4bec-85b3-ff10a26c966f is going to be updated. [ 845.445286] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.445460] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.445460] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.445666] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.445798] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.457956] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a793cfdd-5070-4bec-85b3-ff10a26c966f in Status: IN_PROGRESS for 2s [ 845.538778] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 in Status: SUCCESS [ 845.539095] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.671226] env[65065]: INFO networking_nsxv3.common.synchronization [req-07d15923-b711-4181-bcc5-7a7e3dbd9872 req-de0125a1-b246-439a-808a-1e1c38ee0682 service nova] Enqueued Resource ID: a793cfdd-5070-4bec-85b3-ff10a26c966f with Priority: HIGHEST for action security_group_rules [ 845.671492] env[65065]: INFO networking_nsxv3.common.synchronization [req-07d15923-b711-4181-bcc5-7a7e3dbd9872 req-de0125a1-b246-439a-808a-1e1c38ee0682 service nova] Enqueued Resource ID: a793cfdd-5070-4bec-85b3-ff10a26c966f with Priority: HIGHEST for action security_group_members [ 845.671703] env[65065]: INFO networking_nsxv3.common.synchronization [req-07d15923-b711-4181-bcc5-7a7e3dbd9872 req-de0125a1-b246-439a-808a-1e1c38ee0682 service nova] Enqueued Resource ID: 2c2ab7cd-cf66-4a7c-b009-42cab2c8d225 with Priority: HIGHEST for action port [ 845.673639] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a793cfdd-5070-4bec-85b3-ff10a26c966f with Priority: HIGHEST for action security_group_rules [ 845.673639] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a793cfdd-5070-4bec-85b3-ff10a26c966f with Priority: HIGHEST for action security_group_members [ 845.673639] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c2ab7cd-cf66-4a7c-b009-42cab2c8d225 with Priority: HIGHEST for action port [ 845.673639] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a793cfdd-5070-4bec-85b3-ff10a26c966f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.673820] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a793cfdd-5070-4bec-85b3-ff10a26c966f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.674835] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a793cfdd-5070-4bec-85b3-ff10a26c966f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.674835] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a793cfdd-5070-4bec-85b3-ff10a26c966f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.674835] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a793cfdd-5070-4bec-85b3-ff10a26c966f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.676098] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-a793cfdd-5070-4bec-85b3-ff10a26c966f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.676098] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a793cfdd-5070-4bec-85b3-ff10a26c966f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.677380] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-2c2ab7cd-cf66-4a7c-b009-42cab2c8d225 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.677493] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2c2ab7cd-cf66-4a7c-b009-42cab2c8d225" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.677557] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2c2ab7cd-cf66-4a7c-b009-42cab2c8d225" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.677751] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2c2ab7cd-cf66-4a7c-b009-42cab2c8d225" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.677872] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c2ab7cd-cf66-4a7c-b009-42cab2c8d225',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.177054] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-a793cfdd-5070-4bec-85b3-ff10a26c966f taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.177054] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a793cfdd-5070-4bec-85b3-ff10a26c966f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.183373] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2c2ab7cd-cf66-4a7c-b009-42cab2c8d225 with status ACTIVE [ 846.183701] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.183829] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.183829] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.184031] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.184126] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.184350] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.184460] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.184524] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.184739] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.184831] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.184976] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.185096] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.185157] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.185314] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.185442] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.185551] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2c2ab7cd-cf66-4a7c-b009-42cab2c8d225 is going to be updated. [ 846.209272] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.209397] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.209446] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.209656] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.209852] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.210176] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2c2ab7cd-cf66-4a7c-b009-42cab2c8d225" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.234155] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d38273aa-e7d2-4aea-bcb1-2f5ae899e71f in Status: SUCCESS [ 846.234155] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d38273aa-e7d2-4aea-bcb1-2f5ae899e71f deletion is rescheduled due to dependency. [ 846.234259] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d38273aa-e7d2-4aea-bcb1-2f5ae899e71f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.328346] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea7028db-7886-4f7f-a360-7b19a81fd53e in Status: SUCCESS [ 846.328574] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea7028db-7886-4f7f-a360-7b19a81fd53e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.328739] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea7028db-7886-4f7f-a360-7b19a81fd53e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.329067] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea7028db-7886-4f7f-a360-7b19a81fd53e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.329265] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.329383] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.329497] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.329598] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.329679] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.329762] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea7028db-7886-4f7f-a360-7b19a81fd53e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.329882] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ea7028db-7886-4f7f-a360-7b19a81fd53e',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.731881] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ed22036-e9a4-4639-89b9-c743ca686b09 in Status: SUCCESS [ 846.732820] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ed22036-e9a4-4639-89b9-c743ca686b09 deletion is rescheduled due to dependency. [ 846.732820] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ed22036-e9a4-4639-89b9-c743ca686b09" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.832526] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea7028db-7886-4f7f-a360-7b19a81fd53e taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.832802] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea7028db-7886-4f7f-a360-7b19a81fd53e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.832953] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea7028db-7886-4f7f-a360-7b19a81fd53e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.833301] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea7028db-7886-4f7f-a360-7b19a81fd53e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.833582] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.833771] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.833969] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.834186] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.834340] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.834490] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea7028db-7886-4f7f-a360-7b19a81fd53e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.834746] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea7028db-7886-4f7f-a360-7b19a81fd53e taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.834910] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea7028db-7886-4f7f-a360-7b19a81fd53e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.835049] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea7028db-7886-4f7f-a360-7b19a81fd53e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.835301] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea7028db-7886-4f7f-a360-7b19a81fd53e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.835541] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.835700] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.835869] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.836082] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.836202] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.836319] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea7028db-7886-4f7f-a360-7b19a81fd53e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.836463] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ea7028db-7886-4f7f-a360-7b19a81fd53e',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.339541] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ea7028db-7886-4f7f-a360-7b19a81fd53e: rpc.has_security_group_logging(os_id): False [ 847.360285] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.360285] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.360429] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.360565] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.360676] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.360920] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.361045] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.361122] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.361312] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.361397] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.361579] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.361691] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.361769] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.361930] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.362035] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.362425] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.362425] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.362425] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.362615] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.362916] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.362916] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ea7028db-7886-4f7f-a360-7b19a81fd53e is going to be created. [ 847.429416] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.429606] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.429706] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.429967] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.430208] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.463363] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ea7028db-7886-4f7f-a360-7b19a81fd53e in Status: IN_PROGRESS for 2s [ 847.470822] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a793cfdd-5070-4bec-85b3-ff10a26c966f in Status: SUCCESS [ 847.470822] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a793cfdd-5070-4bec-85b3-ff10a26c966f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.470822] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a793cfdd-5070-4bec-85b3-ff10a26c966f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.471190] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a793cfdd-5070-4bec-85b3-ff10a26c966f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.471596] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.471758] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.471824] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.472053] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.472168] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.472273] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a793cfdd-5070-4bec-85b3-ff10a26c966f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.975534] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a793cfdd-5070-4bec-85b3-ff10a26c966f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.010156] env[65065]: INFO networking_nsxv3.common.synchronization [req-ef251457-5337-42cc-9f3c-2759248597d9 req-ef071a92-d718-4d2b-bab4-e8aaee53e952 tempest-ImagesTestJSON-1714479415 tempest-ImagesTestJSON-1714479415-project-member] Enqueued Resource ID: e6d7baac-4bff-46b9-b88d-2dc982621c0f with Priority: HIGHEST for action security_group_members [ 848.010775] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6d7baac-4bff-46b9-b88d-2dc982621c0f with Priority: HIGHEST for action security_group_members [ 848.011216] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6d7baac-4bff-46b9-b88d-2dc982621c0f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.011490] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.011974] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.012280] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.012504] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.012649] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.012777] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.013007] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.013174] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.013306] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e6d7baac-4bff-46b9-b88d-2dc982621c0f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.478201] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a793cfdd-5070-4bec-85b3-ff10a26c966f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.517986] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e6d7baac-4bff-46b9-b88d-2dc982621c0f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.980821] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.981364] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.981364] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.981364] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.981364] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.981536] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a793cfdd-5070-4bec-85b3-ff10a26c966f is going to be updated. [ 849.011305] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.011524] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.011524] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.011715] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.011856] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.020562] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a793cfdd-5070-4bec-85b3-ff10a26c966f in Status: IN_PROGRESS for 2s [ 849.020772] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e6d7baac-4bff-46b9-b88d-2dc982621c0f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.476503] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ea7028db-7886-4f7f-a360-7b19a81fd53e in Status: SUCCESS [ 849.476503] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ea7028db-7886-4f7f-a360-7b19a81fd53e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.524083] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.524083] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.524083] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.524083] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.524083] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.524083] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6d7baac-4bff-46b9-b88d-2dc982621c0f is going to be updated. [ 849.555888] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.556105] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.556105] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.556326] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.556482] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.566354] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6d7baac-4bff-46b9-b88d-2dc982621c0f in Status: IN_PROGRESS for 2s [ 850.754596] env[65065]: INFO networking_nsxv3.common.synchronization [req-b01cebef-6ebf-4215-9a21-16a747326be5 req-f6adac7d-87ca-4b9e-a80d-115e74d32eaa tempest-AttachInterfacesTestJSON-1590270829 tempest-AttachInterfacesTestJSON-1590270829-project-member] Enqueued Resource ID: e2e5973c-5504-4cd5-9f92-77ba0193d841 with Priority: HIGHEST for action security_group_members [ 850.755166] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2e5973c-5504-4cd5-9f92-77ba0193d841 with Priority: HIGHEST for action security_group_members [ 850.755478] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2e5973c-5504-4cd5-9f92-77ba0193d841 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.755601] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.755665] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.755968] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.756187] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.756187] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.756331] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.756388] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.756473] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.756585] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2e5973c-5504-4cd5-9f92-77ba0193d841',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.030930] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a793cfdd-5070-4bec-85b3-ff10a26c966f in Status: SUCCESS [ 851.031325] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a793cfdd-5070-4bec-85b3-ff10a26c966f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.031495] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a793cfdd-5070-4bec-85b3-ff10a26c966f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.031698] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a793cfdd-5070-4bec-85b3-ff10a26c966f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.031892] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.032125] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.032218] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.032431] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.032547] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.032611] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a793cfdd-5070-4bec-85b3-ff10a26c966f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.032719] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a793cfdd-5070-4bec-85b3-ff10a26c966f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.035228] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock network-688 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.035647] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "network-688" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.035647] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "network-688" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.035844] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "network-688" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.036192] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.036311] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.036462] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.036695] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.036896] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.037239] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 851.037392] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 851.037523] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 851.037652] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 851.037789] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 851.037920] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 851.038089] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 851.057105] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 851.057324] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 851.058035] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 851.058035] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "network-688" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.058035] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock port-4e031152-e6f3-4220-8850-58b3873c881f taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.058454] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "port-4e031152-e6f3-4220-8850-58b3873c881f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.058454] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "port-4e031152-e6f3-4220-8850-58b3873c881f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.058577] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "port-4e031152-e6f3-4220-8850-58b3873c881f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.058753] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4e031152-e6f3-4220-8850-58b3873c881f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.260260] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.260260] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.260260] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.260260] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.260260] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.260260] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.260260] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.260260] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.260260] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.260260] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.260960] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2e5973c-5504-4cd5-9f92-77ba0193d841 already deleted. [ 851.260960] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.540407] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-a793cfdd-5070-4bec-85b3-ff10a26c966f taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.540659] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a793cfdd-5070-4bec-85b3-ff10a26c966f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.540728] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a793cfdd-5070-4bec-85b3-ff10a26c966f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.540971] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a793cfdd-5070-4bec-85b3-ff10a26c966f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.541233] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.541392] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.541439] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.541618] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.541706] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.541824] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a793cfdd-5070-4bec-85b3-ff10a26c966f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.542020] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-a793cfdd-5070-4bec-85b3-ff10a26c966f taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.542167] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a793cfdd-5070-4bec-85b3-ff10a26c966f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.542227] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a793cfdd-5070-4bec-85b3-ff10a26c966f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.542411] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a793cfdd-5070-4bec-85b3-ff10a26c966f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.542570] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.542675] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.542732] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.542909] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.542991] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.543098] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a793cfdd-5070-4bec-85b3-ff10a26c966f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.543189] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a793cfdd-5070-4bec-85b3-ff10a26c966f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.561644] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.561922] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.562047] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.562263] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.562414] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.562567] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Segment Port 4e031152-e6f3-4220-8850-58b3873c881f not found, creating... [ 851.562820] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.563027] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.563121] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.563314] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.563472] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.563754] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.563924] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.564050] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.564252] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.564380] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.564514] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Resource: SegmentPort with ID: 4e031152-e6f3-4220-8850-58b3873c881f is going to be created. [ 851.576956] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6d7baac-4bff-46b9-b88d-2dc982621c0f in Status: SUCCESS [ 851.577219] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.590446] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.590652] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.590944] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.591091] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.591263] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.591487] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "port-4e031152-e6f3-4220-8850-58b3873c881f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.045484] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a793cfdd-5070-4bec-85b3-ff10a26c966f: rpc.has_security_group_logging(os_id): False [ 852.066781] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.067297] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.067297] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.067297] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.067297] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.067563] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.068231] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.068231] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.068231] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.068231] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.068428] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.068604] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.068604] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.068757] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.068833] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.069956] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.069956] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.069956] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.069956] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.069956] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.069956] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a793cfdd-5070-4bec-85b3-ff10a26c966f is going to be updated. [ 852.226131] env[65065]: INFO networking_nsxv3.common.synchronization [req-8a1f5575-8cc1-4340-8a89-f7aa11890415 req-470641fb-8fd9-4a41-9666-13a6d0c4ead0 tempest-ListServerFiltersTestJSON-2126051990 tempest-ListServerFiltersTestJSON-2126051990-project-member] Enqueued Resource ID: b36fec68-8054-450e-a4b6-c700b29fd114 with Priority: HIGHEST for action security_group_members [ 852.228380] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b36fec68-8054-450e-a4b6-c700b29fd114 with Priority: HIGHEST for action security_group_members [ 852.228756] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-b36fec68-8054-450e-a4b6-c700b29fd114 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.228890] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b36fec68-8054-450e-a4b6-c700b29fd114" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.228957] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b36fec68-8054-450e-a4b6-c700b29fd114" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.229276] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b36fec68-8054-450e-a4b6-c700b29fd114" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.229489] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.229591] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.229655] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.229821] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.229922] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.230037] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b36fec68-8054-450e-a4b6-c700b29fd114',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.244952] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.245789] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.245789] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.245789] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.245789] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.259920] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a793cfdd-5070-4bec-85b3-ff10a26c966f in Status: IN_PROGRESS for 2s [ 852.321616] env[65065]: INFO networking_nsxv3.common.synchronization [req-b01cebef-6ebf-4215-9a21-16a747326be5 req-03408d07-538f-437f-9c0a-b528bb20b928 service nova] Enqueued Resource ID: e2e5973c-5504-4cd5-9f92-77ba0193d841 with Priority: HIGHEST for action security_group_rules [ 852.321809] env[65065]: INFO networking_nsxv3.common.synchronization [req-b01cebef-6ebf-4215-9a21-16a747326be5 req-03408d07-538f-437f-9c0a-b528bb20b928 service nova] Enqueued Resource ID: e2e5973c-5504-4cd5-9f92-77ba0193d841 with Priority: HIGHEST for action security_group_members [ 852.321945] env[65065]: INFO networking_nsxv3.common.synchronization [req-b01cebef-6ebf-4215-9a21-16a747326be5 req-03408d07-538f-437f-9c0a-b528bb20b928 service nova] Enqueued Resource ID: 4e031152-e6f3-4220-8850-58b3873c881f with Priority: HIGHEST for action port [ 852.322506] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2e5973c-5504-4cd5-9f92-77ba0193d841 with Priority: HIGHEST for action security_group_rules [ 852.322644] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2e5973c-5504-4cd5-9f92-77ba0193d841 with Priority: HIGHEST for action security_group_members [ 852.322744] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e031152-e6f3-4220-8850-58b3873c881f with Priority: HIGHEST for action port [ 852.323542] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e2e5973c-5504-4cd5-9f92-77ba0193d841 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.323542] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.323542] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.323740] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.323740] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e2e5973c-5504-4cd5-9f92-77ba0193d841',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.325833] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2e5973c-5504-4cd5-9f92-77ba0193d841 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.325833] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.325833] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.326082] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.326082] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.326210] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.326210] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.326367] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.326452] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.326557] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2e5973c-5504-4cd5-9f92-77ba0193d841',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.328046] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-4e031152-e6f3-4220-8850-58b3873c881f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.328175] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4e031152-e6f3-4220-8850-58b3873c881f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.328175] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4e031152-e6f3-4220-8850-58b3873c881f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.328844] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4e031152-e6f3-4220-8850-58b3873c881f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.328971] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4e031152-e6f3-4220-8850-58b3873c881f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.636993] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock network-811 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.637390] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "network-811" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.637534] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "network-811" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.637882] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "network-811" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.642491] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.642864] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.643067] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.643414] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.644020] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.644020] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 852.644020] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 852.644199] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 852.644253] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 852.644416] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 852.644485] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 852.644626] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 852.673667] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 852.674465] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 852.674465] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 852.674772] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "network-811" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.675117] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock port-860b0629-44db-474e-8a50-acf164d30973 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.675383] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "port-860b0629-44db-474e-8a50-acf164d30973" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.675506] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "port-860b0629-44db-474e-8a50-acf164d30973" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.675953] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "port-860b0629-44db-474e-8a50-acf164d30973" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.676208] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('860b0629-44db-474e-8a50-acf164d30973',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.732277] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.732648] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.732958] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.733347] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.733508] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.733928] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.734090] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.734184] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.734838] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.734998] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.735171] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b36fec68-8054-450e-a4b6-c700b29fd114 already deleted. [ 852.735324] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b36fec68-8054-450e-a4b6-c700b29fd114" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.832520] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4e031152-e6f3-4220-8850-58b3873c881f with status ACTIVE [ 852.832874] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.833095] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.833211] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.833504] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.833626] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.833915] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.834065] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.834162] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.834416] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.834546] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.834797] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.834919] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.834985] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.835315] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.835459] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.835562] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4e031152-e6f3-4220-8850-58b3873c881f is going to be updated. [ 852.836925] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e2e5973c-5504-4cd5-9f92-77ba0193d841',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.839071] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2e5973c-5504-4cd5-9f92-77ba0193d841 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.839230] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.864333] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.864591] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.864719] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.865110] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.865361] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.865697] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4e031152-e6f3-4220-8850-58b3873c881f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.179113] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.179503] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.179503] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.180407] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.180589] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.180746] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Segment Port 860b0629-44db-474e-8a50-acf164d30973 not found, creating... [ 853.181055] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.181194] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.181372] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.181569] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.181705] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.182034] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.182202] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.182321] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.182598] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.182731] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.182867] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Resource: SegmentPort with ID: 860b0629-44db-474e-8a50-acf164d30973 is going to be created. [ 853.205046] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.205046] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.205046] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.205357] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.205589] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.205812] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "port-860b0629-44db-474e-8a50-acf164d30973" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.340617] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e2e5973c-5504-4cd5-9f92-77ba0193d841',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.842847] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.843124] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.843273] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.843544] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.844165] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.844165] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2e5973c-5504-4cd5-9f92-77ba0193d841 is going to be created. [ 853.885267] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.885474] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.885523] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.885769] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.886044] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.896768] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2e5973c-5504-4cd5-9f92-77ba0193d841 in Status: UNINITIALIZED for 2s [ 853.941593] env[65065]: INFO networking_nsxv3.common.synchronization [req-8a1f5575-8cc1-4340-8a89-f7aa11890415 req-d8b3ea68-d3f7-4b6d-a16b-8bc760d253bc service nova] Enqueued Resource ID: b36fec68-8054-450e-a4b6-c700b29fd114 with Priority: HIGHEST for action security_group_rules [ 853.941758] env[65065]: INFO networking_nsxv3.common.synchronization [req-8a1f5575-8cc1-4340-8a89-f7aa11890415 req-d8b3ea68-d3f7-4b6d-a16b-8bc760d253bc service nova] Enqueued Resource ID: b36fec68-8054-450e-a4b6-c700b29fd114 with Priority: HIGHEST for action security_group_members [ 853.941886] env[65065]: INFO networking_nsxv3.common.synchronization [req-8a1f5575-8cc1-4340-8a89-f7aa11890415 req-d8b3ea68-d3f7-4b6d-a16b-8bc760d253bc service nova] Enqueued Resource ID: 860b0629-44db-474e-8a50-acf164d30973 with Priority: HIGHEST for action port [ 853.942478] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b36fec68-8054-450e-a4b6-c700b29fd114 with Priority: HIGHEST for action security_group_rules [ 853.942613] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b36fec68-8054-450e-a4b6-c700b29fd114 with Priority: HIGHEST for action security_group_members [ 853.942706] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 860b0629-44db-474e-8a50-acf164d30973 with Priority: HIGHEST for action port [ 853.942987] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b36fec68-8054-450e-a4b6-c700b29fd114 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.943505] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b36fec68-8054-450e-a4b6-c700b29fd114" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.943505] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b36fec68-8054-450e-a4b6-c700b29fd114" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.943818] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b36fec68-8054-450e-a4b6-c700b29fd114" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.943968] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b36fec68-8054-450e-a4b6-c700b29fd114',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.944819] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-b36fec68-8054-450e-a4b6-c700b29fd114 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.944933] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b36fec68-8054-450e-a4b6-c700b29fd114" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.944994] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b36fec68-8054-450e-a4b6-c700b29fd114" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.945187] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b36fec68-8054-450e-a4b6-c700b29fd114" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.945388] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.945935] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.945935] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.946203] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.946203] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.946500] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b36fec68-8054-450e-a4b6-c700b29fd114',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.947279] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-860b0629-44db-474e-8a50-acf164d30973 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.947437] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-860b0629-44db-474e-8a50-acf164d30973" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.947533] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-860b0629-44db-474e-8a50-acf164d30973" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.947709] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-860b0629-44db-474e-8a50-acf164d30973" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.947808] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('860b0629-44db-474e-8a50-acf164d30973',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.275680] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a793cfdd-5070-4bec-85b3-ff10a26c966f in Status: SUCCESS [ 854.275990] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a793cfdd-5070-4bec-85b3-ff10a26c966f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.450590] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b36fec68-8054-450e-a4b6-c700b29fd114',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.451979] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-b36fec68-8054-450e-a4b6-c700b29fd114 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.452184] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b36fec68-8054-450e-a4b6-c700b29fd114" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.452589] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 860b0629-44db-474e-8a50-acf164d30973 with status ACTIVE [ 854.452805] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.452955] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.453896] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.453896] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.453896] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.453896] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.453896] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.453896] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.456050] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.456050] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.456050] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.456050] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.456050] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.456050] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.456576] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.456576] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 860b0629-44db-474e-8a50-acf164d30973 is going to be updated. [ 854.485422] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.485599] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.485703] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.485909] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.486136] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.486460] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-860b0629-44db-474e-8a50-acf164d30973" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.942222] env[65065]: INFO networking_nsxv3.common.synchronization [req-98a3a995-fe04-474a-bd00-f111850c2d73 req-2ff15b82-569c-486a-b086-fde72476df56 tempest-ListServerFiltersTestJSON-2126051990 tempest-ListServerFiltersTestJSON-2126051990-project-member] Enqueued Resource ID: b36fec68-8054-450e-a4b6-c700b29fd114 with Priority: HIGHEST for action security_group_members [ 854.943170] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b36fec68-8054-450e-a4b6-c700b29fd114 with Priority: HIGHEST for action security_group_members [ 854.943555] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-b36fec68-8054-450e-a4b6-c700b29fd114 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.943724] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b36fec68-8054-450e-a4b6-c700b29fd114" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.953262] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b36fec68-8054-450e-a4b6-c700b29fd114',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.317821] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock network-811 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.318154] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "network-811" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.318154] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "network-811" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.318297] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "network-811" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.318611] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.318769] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.318885] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.319143] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.319285] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.319520] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 855.319636] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 855.319773] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 855.319888] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 855.320024] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 855.320159] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 855.320292] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 855.340533] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 855.340714] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 855.340956] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 855.341077] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "network-811" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.341615] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock port-5dde334a-71ef-46e8-94f0-37f20576e2d9 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.341615] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "port-5dde334a-71ef-46e8-94f0-37f20576e2d9" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.341615] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "port-5dde334a-71ef-46e8-94f0-37f20576e2d9" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.342269] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "port-5dde334a-71ef-46e8-94f0-37f20576e2d9" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.342269] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5dde334a-71ef-46e8-94f0-37f20576e2d9',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.458709] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.458709] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.458709] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.458709] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.458709] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.458709] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b36fec68-8054-450e-a4b6-c700b29fd114 is going to be created. [ 855.486714] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.486958] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.487054] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.487608] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.487608] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.501471] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b36fec68-8054-450e-a4b6-c700b29fd114 in Status: UNINITIALIZED for 2s [ 855.845365] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.845618] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.845756] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.846201] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.846372] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.846524] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Segment Port 5dde334a-71ef-46e8-94f0-37f20576e2d9 not found, creating... [ 855.846804] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.846966] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.847131] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.847387] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.847525] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.847849] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.848019] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.848183] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.848456] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.848596] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.848736] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Resource: SegmentPort with ID: 5dde334a-71ef-46e8-94f0-37f20576e2d9 is going to be created. [ 855.879037] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.879731] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.879731] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.879731] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.880090] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.880416] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "port-5dde334a-71ef-46e8-94f0-37f20576e2d9" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.911243] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2e5973c-5504-4cd5-9f92-77ba0193d841 in Status: SUCCESS [ 855.911406] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.911486] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.911694] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.913293] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.913293] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.913293] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.913293] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.913293] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.913293] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.913293] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e2e5973c-5504-4cd5-9f92-77ba0193d841',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.415078] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2e5973c-5504-4cd5-9f92-77ba0193d841 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.415391] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.415391] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.415783] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.415988] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.416158] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.416250] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.416421] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.416508] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.416595] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.416747] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2e5973c-5504-4cd5-9f92-77ba0193d841 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.417066] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.417163] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.417337] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.417494] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.417595] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.417660] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.417806] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.417888] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.417975] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.418079] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e2e5973c-5504-4cd5-9f92-77ba0193d841',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.638700] env[65065]: INFO networking_nsxv3.common.synchronization [req-98a3a995-fe04-474a-bd00-f111850c2d73 req-c1670515-032b-4f91-8672-9445726b882d service nova] Enqueued Resource ID: b36fec68-8054-450e-a4b6-c700b29fd114 with Priority: HIGHEST for action security_group_rules [ 856.638700] env[65065]: INFO networking_nsxv3.common.synchronization [req-98a3a995-fe04-474a-bd00-f111850c2d73 req-c1670515-032b-4f91-8672-9445726b882d service nova] Enqueued Resource ID: b36fec68-8054-450e-a4b6-c700b29fd114 with Priority: HIGHEST for action security_group_members [ 856.638700] env[65065]: INFO networking_nsxv3.common.synchronization [req-98a3a995-fe04-474a-bd00-f111850c2d73 req-c1670515-032b-4f91-8672-9445726b882d service nova] Enqueued Resource ID: 5dde334a-71ef-46e8-94f0-37f20576e2d9 with Priority: HIGHEST for action port [ 856.638700] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b36fec68-8054-450e-a4b6-c700b29fd114 with Priority: HIGHEST for action security_group_rules [ 856.638700] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b36fec68-8054-450e-a4b6-c700b29fd114 with Priority: HIGHEST for action security_group_members [ 856.639207] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5dde334a-71ef-46e8-94f0-37f20576e2d9 with Priority: HIGHEST for action port [ 856.639207] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b36fec68-8054-450e-a4b6-c700b29fd114 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.639350] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b36fec68-8054-450e-a4b6-c700b29fd114" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.639631] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-b36fec68-8054-450e-a4b6-c700b29fd114 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.639752] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b36fec68-8054-450e-a4b6-c700b29fd114" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.640037] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-5dde334a-71ef-46e8-94f0-37f20576e2d9 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.640185] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5dde334a-71ef-46e8-94f0-37f20576e2d9" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.640280] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5dde334a-71ef-46e8-94f0-37f20576e2d9" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.640560] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5dde334a-71ef-46e8-94f0-37f20576e2d9" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.644182] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5dde334a-71ef-46e8-94f0-37f20576e2d9',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.921162] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e2e5973c-5504-4cd5-9f92-77ba0193d841: rpc.has_security_group_logging(os_id): False [ 856.941153] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.941336] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.941388] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.941620] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.941706] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.941969] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.942100] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.942156] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.942329] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.942406] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.942614] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.942709] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.942785] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.942904] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.942984] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.943177] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.943285] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.943341] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.943487] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.943555] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.943652] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e2e5973c-5504-4cd5-9f92-77ba0193d841 is going to be created. [ 857.005079] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.005242] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.005313] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.005558] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.005848] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.018116] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2e5973c-5504-4cd5-9f92-77ba0193d841 in Status: IN_PROGRESS for 2s [ 857.146711] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5dde334a-71ef-46e8-94f0-37f20576e2d9 with status ACTIVE [ 857.147041] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.147191] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.147264] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.147513] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.147640] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.147770] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.147938] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.148067] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.148154] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.148235] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.148435] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.148533] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.148596] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.148751] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.148828] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.148959] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5dde334a-71ef-46e8-94f0-37f20576e2d9 is going to be updated. [ 857.174849] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.175061] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.175061] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.175285] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.175500] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.175659] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5dde334a-71ef-46e8-94f0-37f20576e2d9" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.513693] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b36fec68-8054-450e-a4b6-c700b29fd114 in Status: SUCCESS [ 857.514177] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b36fec68-8054-450e-a4b6-c700b29fd114" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.514177] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b36fec68-8054-450e-a4b6-c700b29fd114" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.514441] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b36fec68-8054-450e-a4b6-c700b29fd114" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.514602] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.514742] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.514834] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.515032] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.515140] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.515228] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b36fec68-8054-450e-a4b6-c700b29fd114" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.515332] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b36fec68-8054-450e-a4b6-c700b29fd114',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.516321] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b36fec68-8054-450e-a4b6-c700b29fd114" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.516529] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b36fec68-8054-450e-a4b6-c700b29fd114" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.517143] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.517143] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.517143] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.517143] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.517426] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.517426] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b36fec68-8054-450e-a4b6-c700b29fd114',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.019571] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-b36fec68-8054-450e-a4b6-c700b29fd114 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.019658] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b36fec68-8054-450e-a4b6-c700b29fd114" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.020063] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b36fec68-8054-450e-a4b6-c700b29fd114',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.456670] env[65065]: INFO networking_nsxv3.common.synchronization [req-f0371f84-7b30-4cce-afa6-85d503b6ef5e req-53a990b0-0e8d-4d98-99a0-a8b3af59ee37 tempest-ListServerFiltersTestJSON-2126051990 tempest-ListServerFiltersTestJSON-2126051990-project-member] Enqueued Resource ID: b36fec68-8054-450e-a4b6-c700b29fd114 with Priority: HIGHEST for action security_group_members [ 858.459555] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b36fec68-8054-450e-a4b6-c700b29fd114 with Priority: HIGHEST for action security_group_members [ 858.459817] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-b36fec68-8054-450e-a4b6-c700b29fd114 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.459817] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b36fec68-8054-450e-a4b6-c700b29fd114" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.524329] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b36fec68-8054-450e-a4b6-c700b29fd114',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.857544] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock network-811 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.857758] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "network-811" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.857931] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "network-811" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.858180] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "network-811" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.858452] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.858603] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.858716] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.859038] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.859217] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.859430] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 858.859539] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 858.859645] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 858.859748] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 858.859853] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 858.859983] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 858.860211] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 858.881640] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 858.882078] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 858.882078] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 858.882678] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "network-811" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.882678] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock port-9c511ab4-744c-4494-8071-83f4531ffd22 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.882902] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "port-9c511ab4-744c-4494-8071-83f4531ffd22" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.882969] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "port-9c511ab4-744c-4494-8071-83f4531ffd22" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.883325] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "port-9c511ab4-744c-4494-8071-83f4531ffd22" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.883492] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9c511ab4-744c-4494-8071-83f4531ffd22',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.945163] env[65065]: INFO networking_nsxv3.common.synchronization [req-0291b6ca-67c3-484d-a3fa-967c727d4d71 req-4fd5ebb8-ea48-4572-92a6-8faf60ccc596 tempest-ServersTestManualDisk-1006050063 tempest-ServersTestManualDisk-1006050063-project-member] Enqueued Resource ID: f9002bdd-0416-4909-9ac7-2b8cecd66558 with Priority: HIGHEST for action security_group_members [ 858.945737] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9002bdd-0416-4909-9ac7-2b8cecd66558 with Priority: HIGHEST for action security_group_members [ 858.946128] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9002bdd-0416-4909-9ac7-2b8cecd66558 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.946267] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9002bdd-0416-4909-9ac7-2b8cecd66558" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.946335] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9002bdd-0416-4909-9ac7-2b8cecd66558" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.947051] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9002bdd-0416-4909-9ac7-2b8cecd66558" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.947051] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.947051] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.947051] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.947051] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.947454] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.947454] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f9002bdd-0416-4909-9ac7-2b8cecd66558',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.027970] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.028410] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.028410] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.028576] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.028671] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.028771] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b36fec68-8054-450e-a4b6-c700b29fd114 is going to be updated. [ 859.030612] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2e5973c-5504-4cd5-9f92-77ba0193d841 in Status: SUCCESS [ 859.030888] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.057705] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.057862] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.057927] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.058164] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.058311] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.068045] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b36fec68-8054-450e-a4b6-c700b29fd114 in Status: IN_PROGRESS for 2s [ 859.356566] env[65065]: INFO networking_nsxv3.common.synchronization [req-f773c47d-1b50-4066-892d-0dea65c95b76 req-d2d0af6b-a363-48d6-bb47-8158e905f0b7 tempest-ServersNegativeTestJSON-1748204548 tempest-ServersNegativeTestJSON-1748204548-project-member] Enqueued Resource ID: a793cfdd-5070-4bec-85b3-ff10a26c966f with Priority: HIGHEST for action security_group_members [ 859.357257] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a793cfdd-5070-4bec-85b3-ff10a26c966f with Priority: HIGHEST for action security_group_members [ 859.357588] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-a793cfdd-5070-4bec-85b3-ff10a26c966f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.357734] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a793cfdd-5070-4bec-85b3-ff10a26c966f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.357866] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a793cfdd-5070-4bec-85b3-ff10a26c966f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.358256] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a793cfdd-5070-4bec-85b3-ff10a26c966f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.358428] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.358531] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.358704] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.358752] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.358831] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.358987] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a793cfdd-5070-4bec-85b3-ff10a26c966f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.385937] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.386198] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.386375] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.386755] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.387080] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.387330] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Segment Port 9c511ab4-744c-4494-8071-83f4531ffd22 not found, creating... [ 859.387676] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.387899] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.388075] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.388339] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.388485] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.388839] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.389100] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.389186] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.389381] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.389718] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.389718] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Resource: SegmentPort with ID: 9c511ab4-744c-4494-8071-83f4531ffd22 is going to be created. [ 859.409781] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.410123] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.410202] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.410442] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.410670] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.410888] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "port-9c511ab4-744c-4494-8071-83f4531ffd22" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.450449] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.450609] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.450699] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.450904] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.450998] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.451212] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.451550] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.451550] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.451550] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.451716] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.451716] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f9002bdd-0416-4909-9ac7-2b8cecd66558 is going to be updated. [ 859.498199] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.498425] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.498425] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.498634] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.498791] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.509429] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9002bdd-0416-4909-9ac7-2b8cecd66558 in Status: IN_PROGRESS for 2s [ 859.564851] env[65065]: INFO networking_nsxv3.common.synchronization [req-3e1085b9-e172-46cc-9ebf-a5272f2dc33b req-a0e7376a-bb82-4dd9-9f4a-32b4996951e3 tempest-ServerAddressesNegativeTestJSON-74501713 tempest-ServerAddressesNegativeTestJSON-74501713-project-member] Enqueued Resource ID: ea7028db-7886-4f7f-a360-7b19a81fd53e with Priority: HIGHEST for action security_group_members [ 859.565489] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea7028db-7886-4f7f-a360-7b19a81fd53e with Priority: HIGHEST for action security_group_members [ 859.565809] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea7028db-7886-4f7f-a360-7b19a81fd53e taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.565927] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea7028db-7886-4f7f-a360-7b19a81fd53e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.566026] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea7028db-7886-4f7f-a360-7b19a81fd53e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.566247] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea7028db-7886-4f7f-a360-7b19a81fd53e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.566413] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.566507] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.566571] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.566757] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.566866] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.566971] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ea7028db-7886-4f7f-a360-7b19a81fd53e',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.861845] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a793cfdd-5070-4bec-85b3-ff10a26c966f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.966807] env[65065]: INFO networking_nsxv3.common.synchronization [req-254472b0-afe1-458e-91f7-fa496cfcbe72 req-7264dc05-a5f7-4004-8d83-a6b83e8b55df tempest-MigrationsAdminTest-1843927703 tempest-MigrationsAdminTest-1843927703-project-member] Enqueued Resource ID: 45ff18a7-4a73-49de-af36-6c1d70b047f6 with Priority: HIGHEST for action security_group_members [ 859.967415] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45ff18a7-4a73-49de-af36-6c1d70b047f6 with Priority: HIGHEST for action security_group_members [ 859.967715] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-45ff18a7-4a73-49de-af36-6c1d70b047f6 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.967834] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45ff18a7-4a73-49de-af36-6c1d70b047f6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.967896] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45ff18a7-4a73-49de-af36-6c1d70b047f6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.968105] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45ff18a7-4a73-49de-af36-6c1d70b047f6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.968249] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.968345] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.968405] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.968552] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.968633] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.968723] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('45ff18a7-4a73-49de-af36-6c1d70b047f6',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.069421] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.069592] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.069665] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.069893] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.070017] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.070221] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.070319] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.070381] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.070528] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.070603] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.070688] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ea7028db-7886-4f7f-a360-7b19a81fd53e is going to be updated. [ 860.105041] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.105041] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.105041] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.105041] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.105041] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.115137] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea7028db-7886-4f7f-a360-7b19a81fd53e in Status: IN_PROGRESS for 2s [ 860.138212] env[65065]: INFO networking_nsxv3.common.synchronization [req-f0371f84-7b30-4cce-afa6-85d503b6ef5e req-a3eb0840-d85b-416f-a356-25aacb9f6b0a service nova] Enqueued Resource ID: b36fec68-8054-450e-a4b6-c700b29fd114 with Priority: HIGHEST for action security_group_rules [ 860.138384] env[65065]: INFO networking_nsxv3.common.synchronization [req-f0371f84-7b30-4cce-afa6-85d503b6ef5e req-a3eb0840-d85b-416f-a356-25aacb9f6b0a service nova] Enqueued Resource ID: b36fec68-8054-450e-a4b6-c700b29fd114 with Priority: HIGHEST for action security_group_members [ 860.138516] env[65065]: INFO networking_nsxv3.common.synchronization [req-f0371f84-7b30-4cce-afa6-85d503b6ef5e req-a3eb0840-d85b-416f-a356-25aacb9f6b0a service nova] Enqueued Resource ID: 9c511ab4-744c-4494-8071-83f4531ffd22 with Priority: HIGHEST for action port [ 860.140111] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b36fec68-8054-450e-a4b6-c700b29fd114 with Priority: HIGHEST for action security_group_rules [ 860.140274] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b36fec68-8054-450e-a4b6-c700b29fd114 with Priority: HIGHEST for action security_group_members [ 860.140369] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c511ab4-744c-4494-8071-83f4531ffd22 with Priority: HIGHEST for action port [ 860.141076] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b36fec68-8054-450e-a4b6-c700b29fd114 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.141211] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b36fec68-8054-450e-a4b6-c700b29fd114" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.141685] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-b36fec68-8054-450e-a4b6-c700b29fd114 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.141685] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b36fec68-8054-450e-a4b6-c700b29fd114" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.141853] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-9c511ab4-744c-4494-8071-83f4531ffd22 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.142046] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9c511ab4-744c-4494-8071-83f4531ffd22" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.142161] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9c511ab4-744c-4494-8071-83f4531ffd22" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.142400] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9c511ab4-744c-4494-8071-83f4531ffd22" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.142486] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9c511ab4-744c-4494-8071-83f4531ffd22',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.366276] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a793cfdd-5070-4bec-85b3-ff10a26c966f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.472646] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('45ff18a7-4a73-49de-af36-6c1d70b047f6',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.647372] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9c511ab4-744c-4494-8071-83f4531ffd22 with status ACTIVE [ 860.647655] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.647792] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.647883] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.648178] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.648262] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.648415] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.648517] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.648573] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.648719] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.648792] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.649026] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.649780] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.649780] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.649780] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.649780] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.649780] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9c511ab4-744c-4494-8071-83f4531ffd22 is going to be updated. [ 860.671353] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.671502] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.671565] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.671775] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.671912] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.672083] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9c511ab4-744c-4494-8071-83f4531ffd22" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.868806] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.869116] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.869260] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.869481] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.869567] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.869665] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a793cfdd-5070-4bec-85b3-ff10a26c966f is going to be updated. [ 860.916214] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.916365] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.916436] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.916649] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.916791] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.930366] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a793cfdd-5070-4bec-85b3-ff10a26c966f in Status: IN_PROGRESS for 2s [ 860.975118] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('45ff18a7-4a73-49de-af36-6c1d70b047f6',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.081375] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b36fec68-8054-450e-a4b6-c700b29fd114 in Status: SUCCESS [ 861.081594] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b36fec68-8054-450e-a4b6-c700b29fd114" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.081768] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b36fec68-8054-450e-a4b6-c700b29fd114" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.081995] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b36fec68-8054-450e-a4b6-c700b29fd114" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.082211] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.082355] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.082400] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.082944] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.082944] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.082944] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b36fec68-8054-450e-a4b6-c700b29fd114',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.478127] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.478410] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.478410] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.478563] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.479191] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.479191] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45ff18a7-4a73-49de-af36-6c1d70b047f6 is going to be updated. [ 861.523144] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9002bdd-0416-4909-9ac7-2b8cecd66558 in Status: SUCCESS [ 861.523372] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f9002bdd-0416-4909-9ac7-2b8cecd66558 deletion is rescheduled due to dependency. [ 861.523582] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9002bdd-0416-4909-9ac7-2b8cecd66558" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.524534] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.524705] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.524781] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.524990] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.525272] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.534525] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45ff18a7-4a73-49de-af36-6c1d70b047f6 in Status: IN_PROGRESS for 2s [ 861.585281] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b36fec68-8054-450e-a4b6-c700b29fd114',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.087620] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b36fec68-8054-450e-a4b6-c700b29fd114',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.127531] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea7028db-7886-4f7f-a360-7b19a81fd53e in Status: SUCCESS [ 862.127713] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ea7028db-7886-4f7f-a360-7b19a81fd53e deletion is rescheduled due to dependency. [ 862.127828] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea7028db-7886-4f7f-a360-7b19a81fd53e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.430107] env[65065]: INFO networking_nsxv3.common.synchronization [None req-d7fd523e-bea0-41b7-b429-72267b5dd9ab tempest-ServerActionsTestJSON-1279756280 tempest-ServerActionsTestJSON-1279756280-project-member] Enqueued Resource ID: 1a8690bf-b436-47bf-abed-9ade6d6d5c3f with Priority: HIGHEST for action security_group_rules [ 862.430712] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a8690bf-b436-47bf-abed-9ade6d6d5c3f with Priority: HIGHEST for action security_group_rules [ 862.431234] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1a8690bf-b436-47bf-abed-9ade6d6d5c3f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.431495] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1a8690bf-b436-47bf-abed-9ade6d6d5c3f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.431495] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1a8690bf-b436-47bf-abed-9ade6d6d5c3f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.431788] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1a8690bf-b436-47bf-abed-9ade6d6d5c3f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.431899] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1a8690bf-b436-47bf-abed-9ade6d6d5c3f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.591380] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.591607] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.591607] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.591826] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.591997] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.591997] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b36fec68-8054-450e-a4b6-c700b29fd114 is going to be updated. [ 862.616210] env[65065]: INFO networking_nsxv3.common.synchronization [None req-e3da13ea-5a5e-49dc-abc6-b4696d253d13 tempest-ServerActionsTestJSON-1279756280 tempest-ServerActionsTestJSON-1279756280-project-member] Enqueued Resource ID: 1a8690bf-b436-47bf-abed-9ade6d6d5c3f with Priority: HIGHEST for action security_group_rules [ 862.616210] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a8690bf-b436-47bf-abed-9ade6d6d5c3f with Priority: HIGHEST for action security_group_rules [ 862.616606] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1a8690bf-b436-47bf-abed-9ade6d6d5c3f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.616948] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1a8690bf-b436-47bf-abed-9ade6d6d5c3f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.632032] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.632032] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.632032] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.632032] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.632032] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.673920] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b36fec68-8054-450e-a4b6-c700b29fd114 in Status: IN_PROGRESS for 2s [ 862.949978] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a793cfdd-5070-4bec-85b3-ff10a26c966f in Status: SUCCESS [ 862.950394] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a793cfdd-5070-4bec-85b3-ff10a26c966f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.956821] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.957426] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.957535] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.957809] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.957852] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.957948] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1a8690bf-b436-47bf-abed-9ade6d6d5c3f already deleted. [ 862.958052] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1a8690bf-b436-47bf-abed-9ade6d6d5c3f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.958209] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1a8690bf-b436-47bf-abed-9ade6d6d5c3f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.958418] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1a8690bf-b436-47bf-abed-9ade6d6d5c3f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.958504] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1a8690bf-b436-47bf-abed-9ade6d6d5c3f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.422088] env[65065]: INFO networking_nsxv3.common.synchronization [req-5abe1504-8414-445d-8064-4d3e33de8a0d req-4570bc68-6268-4f48-be30-6b13c89ff8f6 tempest-ServerPasswordTestJSON-730886141 tempest-ServerPasswordTestJSON-730886141-project-member] Enqueued Resource ID: fd891ad9-a45a-48e0-b198-3697a1e81f8a with Priority: HIGHEST for action security_group_members [ 863.422684] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd891ad9-a45a-48e0-b198-3697a1e81f8a with Priority: HIGHEST for action security_group_members [ 863.422853] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd891ad9-a45a-48e0-b198-3697a1e81f8a taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.422991] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd891ad9-a45a-48e0-b198-3697a1e81f8a" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.423301] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd891ad9-a45a-48e0-b198-3697a1e81f8a" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.423734] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd891ad9-a45a-48e0-b198-3697a1e81f8a" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.423734] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.423734] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.423734] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.424573] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.424573] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.424573] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd891ad9-a45a-48e0-b198-3697a1e81f8a',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.484833] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.485052] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.485052] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.485340] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.485453] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.485580] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1a8690bf-b436-47bf-abed-9ade6d6d5c3f already deleted. [ 863.485729] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1a8690bf-b436-47bf-abed-9ade6d6d5c3f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.545290] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45ff18a7-4a73-49de-af36-6c1d70b047f6 in Status: SUCCESS [ 863.545354] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45ff18a7-4a73-49de-af36-6c1d70b047f6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.851223] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock network-177 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.851223] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "network-177" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.851223] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "network-177" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.851699] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "network-177" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.852198] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.852975] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.853343] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.853769] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.854053] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.854996] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 863.855302] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 863.855524] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 863.857345] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 863.857345] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 863.857345] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 863.857345] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 863.896028] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 863.896028] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Cache value generated in 0.038 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 863.896028] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 863.896028] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "network-177" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.896028] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock port-1f0e5d19-d53e-4b46-8ec6-8075edcb14c7 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.896028] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "port-1f0e5d19-d53e-4b46-8ec6-8075edcb14c7" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.896028] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "port-1f0e5d19-d53e-4b46-8ec6-8075edcb14c7" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.896028] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "port-1f0e5d19-d53e-4b46-8ec6-8075edcb14c7" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.896028] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1f0e5d19-d53e-4b46-8ec6-8075edcb14c7',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.927864] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.928151] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.928223] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.928454] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.928594] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.928824] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.929038] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.929156] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.929381] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.929504] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.929599] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd891ad9-a45a-48e0-b198-3697a1e81f8a already deleted. [ 863.929687] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd891ad9-a45a-48e0-b198-3697a1e81f8a" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.402020] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.402020] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.402020] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.402020] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.402020] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.402020] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Segment Port 1f0e5d19-d53e-4b46-8ec6-8075edcb14c7 not found, creating... [ 864.402020] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.402020] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.402020] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.402020] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.402020] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.402530] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.402530] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.402530] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.403174] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.404050] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.404050] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Resource: SegmentPort with ID: 1f0e5d19-d53e-4b46-8ec6-8075edcb14c7 is going to be created. [ 864.428057] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.428427] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.428644] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.429091] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.429367] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.429641] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "port-1f0e5d19-d53e-4b46-8ec6-8075edcb14c7" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.684032] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b36fec68-8054-450e-a4b6-c700b29fd114 in Status: SUCCESS [ 864.684683] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b36fec68-8054-450e-a4b6-c700b29fd114" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.684683] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b36fec68-8054-450e-a4b6-c700b29fd114" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.684683] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b36fec68-8054-450e-a4b6-c700b29fd114" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.684901] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.684901] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.685026] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.685116] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.685252] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.685310] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b36fec68-8054-450e-a4b6-c700b29fd114" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.685476] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-b36fec68-8054-450e-a4b6-c700b29fd114 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.685559] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b36fec68-8054-450e-a4b6-c700b29fd114" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.685624] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b36fec68-8054-450e-a4b6-c700b29fd114" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.685755] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b36fec68-8054-450e-a4b6-c700b29fd114" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.685894] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.685987] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.686066] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.686191] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.686260] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.686338] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b36fec68-8054-450e-a4b6-c700b29fd114" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.686432] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b36fec68-8054-450e-a4b6-c700b29fd114',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.687364] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b36fec68-8054-450e-a4b6-c700b29fd114" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.687542] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b36fec68-8054-450e-a4b6-c700b29fd114" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.687660] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.687750] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.687888] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.687942] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.688245] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.688245] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b36fec68-8054-450e-a4b6-c700b29fd114',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.189636] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b36fec68-8054-450e-a4b6-c700b29fd114: rpc.has_security_group_logging(os_id): False [ 865.190977] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b36fec68-8054-450e-a4b6-c700b29fd114',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.215293] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.215293] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.215293] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.215491] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.215491] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.215671] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.215764] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.215857] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.216043] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.216043] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.216238] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.216433] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.216474] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.216622] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.216788] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.216910] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.217078] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.217192] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.217258] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.217329] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.217413] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b36fec68-8054-450e-a4b6-c700b29fd114 is going to be created. [ 865.241346] env[65065]: INFO networking_nsxv3.common.synchronization [req-5abe1504-8414-445d-8064-4d3e33de8a0d req-34b00c53-9930-461e-b63f-b031eb00a444 service nova] Enqueued Resource ID: fd891ad9-a45a-48e0-b198-3697a1e81f8a with Priority: HIGHEST for action security_group_rules [ 865.241346] env[65065]: INFO networking_nsxv3.common.synchronization [req-5abe1504-8414-445d-8064-4d3e33de8a0d req-34b00c53-9930-461e-b63f-b031eb00a444 service nova] Enqueued Resource ID: fd891ad9-a45a-48e0-b198-3697a1e81f8a with Priority: HIGHEST for action security_group_members [ 865.241346] env[65065]: INFO networking_nsxv3.common.synchronization [req-5abe1504-8414-445d-8064-4d3e33de8a0d req-34b00c53-9930-461e-b63f-b031eb00a444 service nova] Enqueued Resource ID: 1f0e5d19-d53e-4b46-8ec6-8075edcb14c7 with Priority: HIGHEST for action port [ 865.241763] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd891ad9-a45a-48e0-b198-3697a1e81f8a with Priority: HIGHEST for action security_group_rules [ 865.242106] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd891ad9-a45a-48e0-b198-3697a1e81f8a with Priority: HIGHEST for action security_group_members [ 865.242172] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f0e5d19-d53e-4b46-8ec6-8075edcb14c7 with Priority: HIGHEST for action port [ 865.242541] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fd891ad9-a45a-48e0-b198-3697a1e81f8a taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.242733] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fd891ad9-a45a-48e0-b198-3697a1e81f8a" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.242818] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fd891ad9-a45a-48e0-b198-3697a1e81f8a" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.243166] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fd891ad9-a45a-48e0-b198-3697a1e81f8a" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.243299] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fd891ad9-a45a-48e0-b198-3697a1e81f8a',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.244419] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd891ad9-a45a-48e0-b198-3697a1e81f8a taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.244575] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd891ad9-a45a-48e0-b198-3697a1e81f8a" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.244669] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd891ad9-a45a-48e0-b198-3697a1e81f8a" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.244908] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd891ad9-a45a-48e0-b198-3697a1e81f8a" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.245134] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.245278] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.245383] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.245621] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.245721] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.245873] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd891ad9-a45a-48e0-b198-3697a1e81f8a',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.246841] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-1f0e5d19-d53e-4b46-8ec6-8075edcb14c7 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.246996] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1f0e5d19-d53e-4b46-8ec6-8075edcb14c7" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.247164] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1f0e5d19-d53e-4b46-8ec6-8075edcb14c7" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.247433] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1f0e5d19-d53e-4b46-8ec6-8075edcb14c7" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.247433] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1f0e5d19-d53e-4b46-8ec6-8075edcb14c7',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.286876] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.287098] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.287194] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.290617] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.290875] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.306505] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b36fec68-8054-450e-a4b6-c700b29fd114 in Status: IN_PROGRESS for 2s [ 865.348450] env[65065]: INFO networking_nsxv3.common.synchronization [req-ecde724d-2a95-40c4-859e-a2ee0c53908f req-eb0bb600-9917-41a2-ad2e-287ffe0c1df6 tempest-DeleteServersTestJSON-1316666736 tempest-DeleteServersTestJSON-1316666736-project-member] Enqueued Resource ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 with Priority: HIGHEST for action security_group_members [ 865.349062] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 with Priority: HIGHEST for action security_group_members [ 865.349389] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d0941d4-57d8-45e9-9f2f-95128b8136e5 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.349517] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.349585] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.349789] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.349952] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.350109] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.350191] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.350289] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.350371] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.350480] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d0941d4-57d8-45e9-9f2f-95128b8136e5',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.693071] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b36fec68-8054-450e-a4b6-c700b29fd114',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.753069] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd891ad9-a45a-48e0-b198-3697a1e81f8a taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.753069] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd891ad9-a45a-48e0-b198-3697a1e81f8a" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.753069] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fd891ad9-a45a-48e0-b198-3697a1e81f8a',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.756155] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1f0e5d19-d53e-4b46-8ec6-8075edcb14c7 with status ACTIVE [ 865.756387] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.756517] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.756585] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.756795] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.756888] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.757130] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.757244] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.757299] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.760860] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.760860] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.760860] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.760860] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.760860] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.760860] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.760860] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.760860] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1f0e5d19-d53e-4b46-8ec6-8075edcb14c7 is going to be updated. [ 865.782362] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.782762] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.782762] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.786033] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.786033] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.786033] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1f0e5d19-d53e-4b46-8ec6-8075edcb14c7" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.854849] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.855067] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.855165] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.855502] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.855624] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.855895] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.856041] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.856145] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.856390] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.856472] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.856574] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 is going to be updated. [ 865.907996] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.908206] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.908206] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.908447] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.908621] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.920139] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 in Status: IN_PROGRESS for 2s [ 866.196496] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.196710] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.196813] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.198436] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.198436] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.198436] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b36fec68-8054-450e-a4b6-c700b29fd114 is going to be updated. [ 866.228257] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.228574] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.228574] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.228677] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.228817] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.245017] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b36fec68-8054-450e-a4b6-c700b29fd114 in Status: IN_PROGRESS for 2s [ 866.253991] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fd891ad9-a45a-48e0-b198-3697a1e81f8a',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.697070] env[65065]: INFO networking_nsxv3.common.synchronization [None req-c5a93c85-0113-413f-a216-0d6b83860e66 None None] Enqueued Resource ID: 8f5acf50-b8ee-4950-acc4-d619f10be758 with Priority: HIGHEST for action port [ 866.697583] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f5acf50-b8ee-4950-acc4-d619f10be758 with Priority: HIGHEST for action port [ 866.697912] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-8f5acf50-b8ee-4950-acc4-d619f10be758 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.698053] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8f5acf50-b8ee-4950-acc4-d619f10be758" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.698124] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8f5acf50-b8ee-4950-acc4-d619f10be758" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.698450] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8f5acf50-b8ee-4950-acc4-d619f10be758" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.698535] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8f5acf50-b8ee-4950-acc4-d619f10be758',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.757499] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.757686] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.757793] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.758157] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.758157] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.758271] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd891ad9-a45a-48e0-b198-3697a1e81f8a is going to be created. [ 866.787452] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.787643] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.787715] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.787964] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.788148] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.801258] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd891ad9-a45a-48e0-b198-3697a1e81f8a in Status: UNINITIALIZED for 2s [ 867.201096] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8f5acf50-b8ee-4950-acc4-d619f10be758 [ 867.201414] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.201552] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.201618] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.201833] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.201919] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.202109] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8f5acf50-b8ee-4950-acc4-d619f10be758 already deleted. [ 867.202109] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8f5acf50-b8ee-4950-acc4-d619f10be758" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.323381] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b36fec68-8054-450e-a4b6-c700b29fd114 in Status: SUCCESS [ 867.323381] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b36fec68-8054-450e-a4b6-c700b29fd114" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.323381] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b36fec68-8054-450e-a4b6-c700b29fd114" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.323381] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b36fec68-8054-450e-a4b6-c700b29fd114" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.323381] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b36fec68-8054-450e-a4b6-c700b29fd114',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.824059] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-b36fec68-8054-450e-a4b6-c700b29fd114 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.824422] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b36fec68-8054-450e-a4b6-c700b29fd114" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.937091] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 in Status: SUCCESS [ 867.937225] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 deletion is rescheduled due to dependency. [ 867.937285] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.257028] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b36fec68-8054-450e-a4b6-c700b29fd114 in Status: SUCCESS [ 868.257028] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b36fec68-8054-450e-a4b6-c700b29fd114" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.257028] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b36fec68-8054-450e-a4b6-c700b29fd114" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.257028] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b36fec68-8054-450e-a4b6-c700b29fd114" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.257028] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.257028] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.257028] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.257028] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.257028] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.257028] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b36fec68-8054-450e-a4b6-c700b29fd114',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.759777] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b36fec68-8054-450e-a4b6-c700b29fd114',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.819069] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd891ad9-a45a-48e0-b198-3697a1e81f8a in Status: SUCCESS [ 868.819069] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd891ad9-a45a-48e0-b198-3697a1e81f8a" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.819244] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd891ad9-a45a-48e0-b198-3697a1e81f8a" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.819489] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd891ad9-a45a-48e0-b198-3697a1e81f8a" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.819660] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.819792] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.819852] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.820020] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.820098] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.822371] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd891ad9-a45a-48e0-b198-3697a1e81f8a" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.822371] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fd891ad9-a45a-48e0-b198-3697a1e81f8a',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.986237] env[65065]: INFO networking_nsxv3.common.synchronization [req-7792151f-d209-4d36-aeeb-2f96393fbc7c req-23e38f1d-362b-460d-b5a3-a9c85536c86d tempest-AttachInterfacesTestJSON-1590270829 tempest-AttachInterfacesTestJSON-1590270829-project-member] Enqueued Resource ID: e2e5973c-5504-4cd5-9f92-77ba0193d841 with Priority: HIGHEST for action security_group_members [ 868.986805] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2e5973c-5504-4cd5-9f92-77ba0193d841 with Priority: HIGHEST for action security_group_members [ 868.987125] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2e5973c-5504-4cd5-9f92-77ba0193d841 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.987249] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.987314] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.987503] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.987645] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.987739] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.987795] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.987967] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.990345] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.990345] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2e5973c-5504-4cd5-9f92-77ba0193d841',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.262368] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b36fec68-8054-450e-a4b6-c700b29fd114',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.327020] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd891ad9-a45a-48e0-b198-3697a1e81f8a taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.327020] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd891ad9-a45a-48e0-b198-3697a1e81f8a" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.327020] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd891ad9-a45a-48e0-b198-3697a1e81f8a" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.327020] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd891ad9-a45a-48e0-b198-3697a1e81f8a" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.327020] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.327020] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.327020] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.327020] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.327020] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.327498] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd891ad9-a45a-48e0-b198-3697a1e81f8a" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.327498] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd891ad9-a45a-48e0-b198-3697a1e81f8a taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.327498] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd891ad9-a45a-48e0-b198-3697a1e81f8a" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.327498] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd891ad9-a45a-48e0-b198-3697a1e81f8a" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.327624] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd891ad9-a45a-48e0-b198-3697a1e81f8a" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.327757] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.327849] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.327907] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.328055] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.328263] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.328358] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd891ad9-a45a-48e0-b198-3697a1e81f8a" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.328445] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fd891ad9-a45a-48e0-b198-3697a1e81f8a',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.336556] env[65065]: INFO networking_nsxv3.common.synchronization [None req-f6da4398-90fc-4eb9-8a05-ba5f443a6bc2 None None] Enqueued Resource ID: c42cdff2-6c66-48a8-8895-b572a2f1637b with Priority: HIGHEST for action port [ 869.337195] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c42cdff2-6c66-48a8-8895-b572a2f1637b with Priority: HIGHEST for action port [ 869.337579] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-c42cdff2-6c66-48a8-8895-b572a2f1637b taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.337732] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c42cdff2-6c66-48a8-8895-b572a2f1637b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.337813] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c42cdff2-6c66-48a8-8895-b572a2f1637b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.338092] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c42cdff2-6c66-48a8-8895-b572a2f1637b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.338176] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c42cdff2-6c66-48a8-8895-b572a2f1637b',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.495044] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.495424] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.495424] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.496175] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.496303] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.496539] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.496657] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.496723] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.497044] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.497143] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.497322] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2e5973c-5504-4cd5-9f92-77ba0193d841 is going to be updated. [ 869.531897] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.531897] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.532015] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.533374] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.533374] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.548261] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2e5973c-5504-4cd5-9f92-77ba0193d841 in Status: IN_PROGRESS for 2s [ 869.767356] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.767356] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.767356] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.767356] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.767356] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.767356] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b36fec68-8054-450e-a4b6-c700b29fd114 is going to be updated. [ 869.803993] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.804287] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.804388] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.804685] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.804908] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.818979] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b36fec68-8054-450e-a4b6-c700b29fd114 in Status: IN_PROGRESS for 2s [ 869.831386] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fd891ad9-a45a-48e0-b198-3697a1e81f8a: rpc.has_security_group_logging(os_id): False [ 869.840493] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c42cdff2-6c66-48a8-8895-b572a2f1637b [ 869.840975] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.841192] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.841334] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.841642] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.841748] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.842049] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c42cdff2-6c66-48a8-8895-b572a2f1637b already deleted. [ 869.842184] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c42cdff2-6c66-48a8-8895-b572a2f1637b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.870183] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.870183] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.870183] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.870183] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.870183] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.870183] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.870183] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.870183] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.870183] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.870183] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.870183] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.870183] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.870183] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.870183] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.870183] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.870589] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.870589] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.870589] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.872251] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.872336] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.872682] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fd891ad9-a45a-48e0-b198-3697a1e81f8a is going to be created. [ 869.957713] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.957884] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.957956] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.958223] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.958433] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.974956] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fd891ad9-a45a-48e0-b198-3697a1e81f8a in Status: IN_PROGRESS for 2s [ 870.610020] env[65065]: INFO networking_nsxv3.common.synchronization [req-e17fa95e-4426-43db-939f-61a97ec91c86 req-a9723768-2f40-435f-a883-9cb0a265f2be tempest-ServersAdminTestJSON-1746807080 tempest-ServersAdminTestJSON-1746807080-project-member] Enqueued Resource ID: ed4053b7-493c-48f8-b82e-b002cbcc3a61 with Priority: HIGHEST for action security_group_members [ 870.610588] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed4053b7-493c-48f8-b82e-b002cbcc3a61 with Priority: HIGHEST for action security_group_members [ 870.610906] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed4053b7-493c-48f8-b82e-b002cbcc3a61 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.611057] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.611134] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.611298] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.611448] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.611555] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.611636] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.611751] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.611832] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.611928] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ed4053b7-493c-48f8-b82e-b002cbcc3a61',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.114231] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.114399] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.114473] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.114725] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.114886] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.115113] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.115214] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.115277] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.115435] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.115510] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.115593] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ed4053b7-493c-48f8-b82e-b002cbcc3a61 is going to be updated. [ 871.148083] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.148083] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.148083] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.148083] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.148083] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.159367] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed4053b7-493c-48f8-b82e-b002cbcc3a61 in Status: IN_PROGRESS for 2s [ 871.565067] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2e5973c-5504-4cd5-9f92-77ba0193d841 in Status: SUCCESS [ 871.565265] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2e5973c-5504-4cd5-9f92-77ba0193d841 deletion is rescheduled due to dependency. [ 871.565400] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.830364] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b36fec68-8054-450e-a4b6-c700b29fd114 in Status: SUCCESS [ 871.830623] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b36fec68-8054-450e-a4b6-c700b29fd114" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.830725] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b36fec68-8054-450e-a4b6-c700b29fd114" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.830930] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b36fec68-8054-450e-a4b6-c700b29fd114" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.831138] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.831258] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.831334] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.831498] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.831586] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.831657] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b36fec68-8054-450e-a4b6-c700b29fd114" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.831747] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b36fec68-8054-450e-a4b6-c700b29fd114',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.989053] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fd891ad9-a45a-48e0-b198-3697a1e81f8a in Status: SUCCESS [ 871.989771] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fd891ad9-a45a-48e0-b198-3697a1e81f8a" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.336848] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-b36fec68-8054-450e-a4b6-c700b29fd114 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.337244] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b36fec68-8054-450e-a4b6-c700b29fd114" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.337372] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b36fec68-8054-450e-a4b6-c700b29fd114" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.338081] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b36fec68-8054-450e-a4b6-c700b29fd114" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.338399] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.338513] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.338567] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.338752] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.338873] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.339089] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b36fec68-8054-450e-a4b6-c700b29fd114" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.339404] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-b36fec68-8054-450e-a4b6-c700b29fd114 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.339495] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b36fec68-8054-450e-a4b6-c700b29fd114" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.339580] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b36fec68-8054-450e-a4b6-c700b29fd114" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.340181] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b36fec68-8054-450e-a4b6-c700b29fd114" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.340434] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.340567] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.340653] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.340837] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.340943] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.341069] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b36fec68-8054-450e-a4b6-c700b29fd114" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.341257] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b36fec68-8054-450e-a4b6-c700b29fd114',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.843986] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b36fec68-8054-450e-a4b6-c700b29fd114: rpc.has_security_group_logging(os_id): False [ 872.866874] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.866874] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.866874] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.867050] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.867161] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.867330] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.867427] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.867484] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.867648] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.867716] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.867906] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.868013] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.868082] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.868214] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.868284] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.868473] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.868566] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.868619] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.868749] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.868817] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.868898] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b36fec68-8054-450e-a4b6-c700b29fd114 is going to be updated. [ 872.949949] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.949949] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.949949] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.950237] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.950318] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.967368] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b36fec68-8054-450e-a4b6-c700b29fd114 in Status: IN_PROGRESS for 2s [ 873.170664] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed4053b7-493c-48f8-b82e-b002cbcc3a61 in Status: SUCCESS [ 873.170849] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ed4053b7-493c-48f8-b82e-b002cbcc3a61 deletion is rescheduled due to dependency. [ 873.170972] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.887469] env[65065]: INFO networking_nsxv3.common.synchronization [req-47bd2bae-746f-45f0-88c0-655f612ae8dc req-0e6eeede-acad-43f8-854b-2ac9954ec7e6 tempest-AttachInterfacesTestJSON-1590270829 tempest-AttachInterfacesTestJSON-1590270829-project-member] Enqueued Resource ID: 7299f16a-2557-464b-9f29-2b3b8469fc29 with Priority: HIGHEST for action security_group_members [ 873.888091] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7299f16a-2557-464b-9f29-2b3b8469fc29 with Priority: HIGHEST for action security_group_members [ 873.888491] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-7299f16a-2557-464b-9f29-2b3b8469fc29 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.888629] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7299f16a-2557-464b-9f29-2b3b8469fc29" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.888801] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7299f16a-2557-464b-9f29-2b3b8469fc29" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.888893] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7299f16a-2557-464b-9f29-2b3b8469fc29" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.889151] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.889256] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.889347] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.889514] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.889599] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.889692] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7299f16a-2557-464b-9f29-2b3b8469fc29',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.995995] env[65065]: INFO networking_nsxv3.common.synchronization [None req-35f537de-d19a-40cb-88b0-341c92353a66 None None] Enqueued Resource ID: a898d1d3-cafb-4382-ba09-20f19cd4f9b7 with Priority: HIGHEST for action port [ 873.995995] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a898d1d3-cafb-4382-ba09-20f19cd4f9b7 with Priority: HIGHEST for action port [ 873.995995] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-a898d1d3-cafb-4382-ba09-20f19cd4f9b7 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.996935] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a898d1d3-cafb-4382-ba09-20f19cd4f9b7" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.996935] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a898d1d3-cafb-4382-ba09-20f19cd4f9b7" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.997175] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a898d1d3-cafb-4382-ba09-20f19cd4f9b7" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.997423] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a898d1d3-cafb-4382-ba09-20f19cd4f9b7',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.392578] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.393020] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.393020] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.393283] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.393283] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.394582] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.394582] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.394582] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.394582] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.394582] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.394582] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7299f16a-2557-464b-9f29-2b3b8469fc29 is going to be updated. [ 874.424692] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.424692] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.424692] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.424692] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.424692] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.433579] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7299f16a-2557-464b-9f29-2b3b8469fc29 in Status: IN_PROGRESS for 2s [ 874.503543] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a898d1d3-cafb-4382-ba09-20f19cd4f9b7 [ 874.503543] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.503543] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.503543] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.503543] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.503543] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.503543] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a898d1d3-cafb-4382-ba09-20f19cd4f9b7 already deleted. [ 874.503543] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a898d1d3-cafb-4382-ba09-20f19cd4f9b7" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.982740] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b36fec68-8054-450e-a4b6-c700b29fd114 in Status: SUCCESS [ 874.982740] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b36fec68-8054-450e-a4b6-c700b29fd114" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.983051] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b36fec68-8054-450e-a4b6-c700b29fd114" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.983051] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b36fec68-8054-450e-a4b6-c700b29fd114" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.983126] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b36fec68-8054-450e-a4b6-c700b29fd114',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.488577] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-b36fec68-8054-450e-a4b6-c700b29fd114 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.488689] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b36fec68-8054-450e-a4b6-c700b29fd114" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.488795] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b36fec68-8054-450e-a4b6-c700b29fd114" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.489947] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b36fec68-8054-450e-a4b6-c700b29fd114" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.489947] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.489947] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.489947] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.489947] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.489947] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.489947] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b36fec68-8054-450e-a4b6-c700b29fd114" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.489947] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b36fec68-8054-450e-a4b6-c700b29fd114',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.995200] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-b36fec68-8054-450e-a4b6-c700b29fd114 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.995484] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b36fec68-8054-450e-a4b6-c700b29fd114" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.995484] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b36fec68-8054-450e-a4b6-c700b29fd114" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.995690] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b36fec68-8054-450e-a4b6-c700b29fd114" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.996013] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.996013] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.996013] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.996164] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.996164] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.996254] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b36fec68-8054-450e-a4b6-c700b29fd114" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.996392] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-b36fec68-8054-450e-a4b6-c700b29fd114 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.996478] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b36fec68-8054-450e-a4b6-c700b29fd114" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.996534] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b36fec68-8054-450e-a4b6-c700b29fd114" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.996812] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b36fec68-8054-450e-a4b6-c700b29fd114" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.996812] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.996914] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.996948] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.997286] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.997361] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.997439] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b36fec68-8054-450e-a4b6-c700b29fd114" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.997525] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b36fec68-8054-450e-a4b6-c700b29fd114',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.195229] env[65065]: INFO networking_nsxv3.common.synchronization [None req-4a47b5b5-ea9d-434c-9271-e464382488ca None None] Enqueued Resource ID: a5e2c301-5ae0-41a8-a91b-d4c0ef262dea with Priority: HIGHEST for action port [ 876.195765] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5e2c301-5ae0-41a8-a91b-d4c0ef262dea with Priority: HIGHEST for action port [ 876.196143] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-a5e2c301-5ae0-41a8-a91b-d4c0ef262dea taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.196270] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a5e2c301-5ae0-41a8-a91b-d4c0ef262dea" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.196333] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a5e2c301-5ae0-41a8-a91b-d4c0ef262dea" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.197165] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a5e2c301-5ae0-41a8-a91b-d4c0ef262dea" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.197165] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a5e2c301-5ae0-41a8-a91b-d4c0ef262dea',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.447318] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7299f16a-2557-464b-9f29-2b3b8469fc29 in Status: SUCCESS [ 876.447318] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7299f16a-2557-464b-9f29-2b3b8469fc29 deletion is rescheduled due to dependency. [ 876.447318] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7299f16a-2557-464b-9f29-2b3b8469fc29" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.500454] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b36fec68-8054-450e-a4b6-c700b29fd114: rpc.has_security_group_logging(os_id): False [ 876.522735] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.522895] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.522959] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.523199] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.523371] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.523998] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.523998] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.523998] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.523998] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.523998] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.524236] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.524278] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.525197] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.526373] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.526544] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.526743] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.526882] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.526937] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.527183] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.527246] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.527319] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b36fec68-8054-450e-a4b6-c700b29fd114 is going to be updated. [ 876.598740] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.598920] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.599125] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.600535] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.600535] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.614350] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b36fec68-8054-450e-a4b6-c700b29fd114 in Status: IN_PROGRESS for 2s [ 876.699398] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a5e2c301-5ae0-41a8-a91b-d4c0ef262dea [ 876.699697] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.699929] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.700149] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.700489] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.700688] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.700868] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a5e2c301-5ae0-41a8-a91b-d4c0ef262dea already deleted. [ 876.701040] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a5e2c301-5ae0-41a8-a91b-d4c0ef262dea" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.629321] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b36fec68-8054-450e-a4b6-c700b29fd114 in Status: SUCCESS [ 878.629624] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b36fec68-8054-450e-a4b6-c700b29fd114" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.802092] env[65065]: INFO networking_nsxv3.common.synchronization [req-67a2df78-4326-45f4-9de4-e4935bbbe554 req-58133b3a-df2d-4a97-8eb7-74ec23e71902 tempest-ServerPasswordTestJSON-730886141 tempest-ServerPasswordTestJSON-730886141-project-member] Enqueued Resource ID: fd891ad9-a45a-48e0-b198-3697a1e81f8a with Priority: HIGHEST for action security_group_members [ 878.802619] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd891ad9-a45a-48e0-b198-3697a1e81f8a with Priority: HIGHEST for action security_group_members [ 878.803127] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd891ad9-a45a-48e0-b198-3697a1e81f8a taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.803127] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd891ad9-a45a-48e0-b198-3697a1e81f8a" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.803127] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd891ad9-a45a-48e0-b198-3697a1e81f8a" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.803293] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd891ad9-a45a-48e0-b198-3697a1e81f8a" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.803441] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.803537] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.803600] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.803739] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.803822] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.803910] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd891ad9-a45a-48e0-b198-3697a1e81f8a',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.306651] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.308533] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.308533] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.308533] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.308533] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.308533] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.308533] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.308533] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.308533] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.308533] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.308533] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd891ad9-a45a-48e0-b198-3697a1e81f8a is going to be updated. [ 879.338370] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.338370] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.338370] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.338370] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.338370] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.347384] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd891ad9-a45a-48e0-b198-3697a1e81f8a in Status: IN_PROGRESS for 2s [ 881.358966] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd891ad9-a45a-48e0-b198-3697a1e81f8a in Status: SUCCESS [ 881.359463] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd891ad9-a45a-48e0-b198-3697a1e81f8a deletion is rescheduled due to dependency. [ 881.359463] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd891ad9-a45a-48e0-b198-3697a1e81f8a" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.185106] env[65065]: INFO networking_nsxv3.common.synchronization [req-72f509f5-761d-48be-95f0-b8a56489189d req-559002be-846b-4e0c-ac44-38028ccb9f09 tempest-ImagesTestJSON-1714479415 tempest-ImagesTestJSON-1714479415-project-member] Enqueued Resource ID: e6d7baac-4bff-46b9-b88d-2dc982621c0f with Priority: HIGHEST for action security_group_members [ 883.185106] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6d7baac-4bff-46b9-b88d-2dc982621c0f with Priority: HIGHEST for action security_group_members [ 883.185106] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6d7baac-4bff-46b9-b88d-2dc982621c0f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.185106] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.185106] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.185106] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.185106] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.185106] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.185106] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.186312] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.186418] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.186590] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e6d7baac-4bff-46b9-b88d-2dc982621c0f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.689252] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.689403] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.689621] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.689691] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.689775] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.689972] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.690096] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.690137] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.690470] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.690470] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.690470] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6d7baac-4bff-46b9-b88d-2dc982621c0f is going to be updated. [ 883.723743] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.724854] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.724854] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.724854] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.724854] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.733569] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6d7baac-4bff-46b9-b88d-2dc982621c0f in Status: IN_PROGRESS for 2s [ 884.054691] env[65065]: INFO networking_nsxv3.common.synchronization [req-42913479-67e3-4d83-86c1-270f16a3e057 req-57f81228-04be-4dc6-bd79-287dfe245450 tempest-ServerActionsTestJSON-1279756280 tempest-ServerActionsTestJSON-1279756280-project-member] Enqueued Resource ID: 1a8690bf-b436-47bf-abed-9ade6d6d5c3f with Priority: HIGHEST for action security_group_members [ 884.055261] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a8690bf-b436-47bf-abed-9ade6d6d5c3f with Priority: HIGHEST for action security_group_members [ 884.055544] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-1a8690bf-b436-47bf-abed-9ade6d6d5c3f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.055665] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1a8690bf-b436-47bf-abed-9ade6d6d5c3f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.055732] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1a8690bf-b436-47bf-abed-9ade6d6d5c3f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.056017] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1a8690bf-b436-47bf-abed-9ade6d6d5c3f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.056275] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.056378] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.056442] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.056699] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.056699] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.056781] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1a8690bf-b436-47bf-abed-9ade6d6d5c3f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.560585] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.560585] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.560585] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.560585] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.560585] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.561017] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.561017] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.561147] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.561273] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.561364] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.561452] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1a8690bf-b436-47bf-abed-9ade6d6d5c3f already deleted. [ 884.561533] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1a8690bf-b436-47bf-abed-9ade6d6d5c3f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.662400] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock network-502 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.662658] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "network-502" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.662817] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "network-502" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.663215] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "network-502" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.663542] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.663738] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.663860] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.664337] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.664508] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.664887] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 884.664887] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 884.664994] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 884.665122] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 884.665231] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 884.665333] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 884.665463] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 884.685764] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 884.685931] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 884.686088] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 884.686319] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "network-502" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.686786] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock port-b5cc173f-6147-4210-be53-d0d4eeb671b5 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.687079] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "port-b5cc173f-6147-4210-be53-d0d4eeb671b5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.688396] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "port-b5cc173f-6147-4210-be53-d0d4eeb671b5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.688881] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "port-b5cc173f-6147-4210-be53-d0d4eeb671b5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.689227] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b5cc173f-6147-4210-be53-d0d4eeb671b5',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.192382] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.192601] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.192734] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.193129] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.193305] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.193517] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Segment Port b5cc173f-6147-4210-be53-d0d4eeb671b5 not found, creating... [ 885.193811] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.194011] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.194172] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.194434] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.194598] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.194913] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.195134] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.195301] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.195521] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.195687] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.195850] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Resource: SegmentPort with ID: b5cc173f-6147-4210-be53-d0d4eeb671b5 is going to be created. [ 885.217745] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.218085] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.218230] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.218619] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.218740] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.218962] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "port-b5cc173f-6147-4210-be53-d0d4eeb671b5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.747131] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6d7baac-4bff-46b9-b88d-2dc982621c0f in Status: SUCCESS [ 885.747428] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6d7baac-4bff-46b9-b88d-2dc982621c0f deletion is rescheduled due to dependency. [ 885.747474] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.934344] env[65065]: INFO networking_nsxv3.common.synchronization [req-42913479-67e3-4d83-86c1-270f16a3e057 req-eb2a113c-c3f5-4dbb-a5b5-78cd7bb9fc97 service nova] Enqueued Resource ID: 1a8690bf-b436-47bf-abed-9ade6d6d5c3f with Priority: HIGHEST for action security_group_rules [ 885.934344] env[65065]: INFO networking_nsxv3.common.synchronization [req-42913479-67e3-4d83-86c1-270f16a3e057 req-eb2a113c-c3f5-4dbb-a5b5-78cd7bb9fc97 service nova] Enqueued Resource ID: 1a8690bf-b436-47bf-abed-9ade6d6d5c3f with Priority: HIGHEST for action security_group_members [ 885.934344] env[65065]: INFO networking_nsxv3.common.synchronization [req-42913479-67e3-4d83-86c1-270f16a3e057 req-eb2a113c-c3f5-4dbb-a5b5-78cd7bb9fc97 service nova] Enqueued Resource ID: b5cc173f-6147-4210-be53-d0d4eeb671b5 with Priority: HIGHEST for action port [ 885.934344] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a8690bf-b436-47bf-abed-9ade6d6d5c3f with Priority: HIGHEST for action security_group_rules [ 885.934344] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a8690bf-b436-47bf-abed-9ade6d6d5c3f with Priority: HIGHEST for action security_group_members [ 885.934344] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5cc173f-6147-4210-be53-d0d4eeb671b5 with Priority: HIGHEST for action port [ 885.935447] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1a8690bf-b436-47bf-abed-9ade6d6d5c3f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.938348] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1a8690bf-b436-47bf-abed-9ade6d6d5c3f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.938348] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1a8690bf-b436-47bf-abed-9ade6d6d5c3f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.938348] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1a8690bf-b436-47bf-abed-9ade6d6d5c3f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.938348] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1a8690bf-b436-47bf-abed-9ade6d6d5c3f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.938348] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-1a8690bf-b436-47bf-abed-9ade6d6d5c3f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.938348] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1a8690bf-b436-47bf-abed-9ade6d6d5c3f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.938348] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1a8690bf-b436-47bf-abed-9ade6d6d5c3f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.938348] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1a8690bf-b436-47bf-abed-9ade6d6d5c3f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.938348] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.938348] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.938348] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.938348] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.938696] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.938696] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1a8690bf-b436-47bf-abed-9ade6d6d5c3f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.943090] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-b5cc173f-6147-4210-be53-d0d4eeb671b5 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.943090] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b5cc173f-6147-4210-be53-d0d4eeb671b5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.943090] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b5cc173f-6147-4210-be53-d0d4eeb671b5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.943090] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b5cc173f-6147-4210-be53-d0d4eeb671b5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.943090] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b5cc173f-6147-4210-be53-d0d4eeb671b5',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.444633] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-1a8690bf-b436-47bf-abed-9ade6d6d5c3f taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.444633] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1a8690bf-b436-47bf-abed-9ade6d6d5c3f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.444633] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1a8690bf-b436-47bf-abed-9ade6d6d5c3f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.444633] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b5cc173f-6147-4210-be53-d0d4eeb671b5 with status ACTIVE [ 886.444633] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.444633] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.444633] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.444633] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.444633] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.444633] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.444633] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.444633] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.445520] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.445754] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.446116] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.447396] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.447396] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.448211] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.448211] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.448517] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b5cc173f-6147-4210-be53-d0d4eeb671b5 is going to be updated. [ 886.483275] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.483404] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.483472] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.483686] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.483820] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.484731] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b5cc173f-6147-4210-be53-d0d4eeb671b5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.952499] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1a8690bf-b436-47bf-abed-9ade6d6d5c3f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.454786] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.455051] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.455051] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.455224] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.455307] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.455648] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1a8690bf-b436-47bf-abed-9ade6d6d5c3f is going to be created. [ 887.481294] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.481436] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.481492] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.481688] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.481841] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.495021] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1a8690bf-b436-47bf-abed-9ade6d6d5c3f in Status: UNINITIALIZED for 2s [ 888.164228] env[65065]: INFO networking_nsxv3.common.synchronization [None req-1f63a3e5-bcc3-45b4-80ce-7978fa12b00f None None] Enqueued Resource ID: abf25f68-db9d-45fd-98bf-8bfdfaaaa8ac with Priority: HIGHEST for action port [ 888.164589] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abf25f68-db9d-45fd-98bf-8bfdfaaaa8ac with Priority: HIGHEST for action port [ 888.165164] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-abf25f68-db9d-45fd-98bf-8bfdfaaaa8ac taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.165164] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-abf25f68-db9d-45fd-98bf-8bfdfaaaa8ac" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.165366] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-abf25f68-db9d-45fd-98bf-8bfdfaaaa8ac" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.165488] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-abf25f68-db9d-45fd-98bf-8bfdfaaaa8ac" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.165576] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('abf25f68-db9d-45fd-98bf-8bfdfaaaa8ac',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.246663] env[65065]: INFO networking_nsxv3.common.synchronization [req-4b4a9318-0e9e-49cc-97a5-dfca5501929f req-ed0327ec-a4ac-492f-9a68-71867009b71a tempest-ServersTestJSON-1126920631 tempest-ServersTestJSON-1126920631-project-member] Enqueued Resource ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 with Priority: HIGHEST for action security_group_members [ 888.247473] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 with Priority: HIGHEST for action security_group_members [ 888.247806] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e5f0086-b1e3-4f00-8207-8306f153d0e4 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.248068] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.248141] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.248390] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.248619] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.248765] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.248835] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.248996] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.249145] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.249251] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e5f0086-b1e3-4f00-8207-8306f153d0e4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.668515] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port abf25f68-db9d-45fd-98bf-8bfdfaaaa8ac [ 888.668776] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.668916] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.669070] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.670027] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.670027] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.670027] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:abf25f68-db9d-45fd-98bf-8bfdfaaaa8ac already deleted. [ 888.670027] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-abf25f68-db9d-45fd-98bf-8bfdfaaaa8ac" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.752623] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.752811] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.752811] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.753035] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.753128] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.753329] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.753429] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.753490] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.753651] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.753824] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.753824] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 already deleted. [ 888.753920] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.902822] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock network-381 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.903030] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "network-381" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.903160] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "network-381" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.903498] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "network-381" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.903760] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.903917] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.904232] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.904494] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.904646] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.904856] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 888.904964] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 888.905081] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 888.905188] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 888.905389] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 888.905502] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 888.905634] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 888.926820] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 888.926820] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 888.926963] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 888.927136] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "network-381" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.927493] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock port-6cd057ef-479a-4d6e-a5f3-528432c64127 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.927673] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "port-6cd057ef-479a-4d6e-a5f3-528432c64127" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.927785] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "port-6cd057ef-479a-4d6e-a5f3-528432c64127" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.928133] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "port-6cd057ef-479a-4d6e-a5f3-528432c64127" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.928317] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6cd057ef-479a-4d6e-a5f3-528432c64127',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.430897] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.431195] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.431261] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.431560] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.431750] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.431847] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Segment Port 6cd057ef-479a-4d6e-a5f3-528432c64127 not found, creating... [ 889.432107] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.432257] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.432362] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.432563] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.432693] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.432961] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.433124] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.433236] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.433785] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.433785] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.433785] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Resource: SegmentPort with ID: 6cd057ef-479a-4d6e-a5f3-528432c64127 is going to be created. [ 889.454659] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.454969] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.455140] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.455448] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.455806] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.456733] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "port-6cd057ef-479a-4d6e-a5f3-528432c64127" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.508630] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1a8690bf-b436-47bf-abed-9ade6d6d5c3f in Status: SUCCESS [ 889.509256] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1a8690bf-b436-47bf-abed-9ade6d6d5c3f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.509314] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1a8690bf-b436-47bf-abed-9ade6d6d5c3f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.509616] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1a8690bf-b436-47bf-abed-9ade6d6d5c3f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.509917] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.511345] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.511345] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.511345] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.511345] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.511345] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1a8690bf-b436-47bf-abed-9ade6d6d5c3f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.511345] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1a8690bf-b436-47bf-abed-9ade6d6d5c3f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.957308] env[65065]: INFO networking_nsxv3.common.synchronization [None req-fab05c07-4449-44c4-a635-0abd57d73c07 None None] Enqueued Resource ID: 59251231-0062-455e-a42c-b51620ca89d5 with Priority: HIGHEST for action port [ 889.957847] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59251231-0062-455e-a42c-b51620ca89d5 with Priority: HIGHEST for action port [ 889.958233] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-59251231-0062-455e-a42c-b51620ca89d5 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.958360] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-59251231-0062-455e-a42c-b51620ca89d5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.958428] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-59251231-0062-455e-a42c-b51620ca89d5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.958680] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-59251231-0062-455e-a42c-b51620ca89d5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.958765] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('59251231-0062-455e-a42c-b51620ca89d5',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.015288] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1a8690bf-b436-47bf-abed-9ade6d6d5c3f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.191735] env[65065]: INFO networking_nsxv3.common.synchronization [req-4b4a9318-0e9e-49cc-97a5-dfca5501929f req-44d5e6fb-4c2f-43d8-b65f-a6b82d537ad4 service nova] Enqueued Resource ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 with Priority: HIGHEST for action security_group_rules [ 890.191735] env[65065]: INFO networking_nsxv3.common.synchronization [req-4b4a9318-0e9e-49cc-97a5-dfca5501929f req-44d5e6fb-4c2f-43d8-b65f-a6b82d537ad4 service nova] Enqueued Resource ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 with Priority: HIGHEST for action security_group_members [ 890.191735] env[65065]: INFO networking_nsxv3.common.synchronization [req-4b4a9318-0e9e-49cc-97a5-dfca5501929f req-44d5e6fb-4c2f-43d8-b65f-a6b82d537ad4 service nova] Enqueued Resource ID: 6cd057ef-479a-4d6e-a5f3-528432c64127 with Priority: HIGHEST for action port [ 890.192291] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 with Priority: HIGHEST for action security_group_rules [ 890.192455] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 with Priority: HIGHEST for action security_group_members [ 890.192562] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6cd057ef-479a-4d6e-a5f3-528432c64127 with Priority: HIGHEST for action port [ 890.192841] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1e5f0086-b1e3-4f00-8207-8306f153d0e4 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.192962] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.193044] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.193317] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.193400] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1e5f0086-b1e3-4f00-8207-8306f153d0e4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.194283] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e5f0086-b1e3-4f00-8207-8306f153d0e4 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.194389] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.194459] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.194619] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.194744] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.194881] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.194914] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.195461] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.195461] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.195461] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e5f0086-b1e3-4f00-8207-8306f153d0e4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.196049] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-6cd057ef-479a-4d6e-a5f3-528432c64127 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.202036] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6cd057ef-479a-4d6e-a5f3-528432c64127" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.202036] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6cd057ef-479a-4d6e-a5f3-528432c64127" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.202036] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6cd057ef-479a-4d6e-a5f3-528432c64127" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.202036] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6cd057ef-479a-4d6e-a5f3-528432c64127',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.308249] env[65065]: INFO networking_nsxv3.common.synchronization [None req-ab91a0aa-51d6-4658-b927-7a0f73d0a0b7 None None] Enqueued Resource ID: 92032a9b-3873-4554-b53c-134b6d018445 with Priority: HIGHEST for action port [ 890.309036] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92032a9b-3873-4554-b53c-134b6d018445 with Priority: HIGHEST for action port [ 890.309294] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-92032a9b-3873-4554-b53c-134b6d018445 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.310067] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-92032a9b-3873-4554-b53c-134b6d018445" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.310067] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-92032a9b-3873-4554-b53c-134b6d018445" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.310067] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-92032a9b-3873-4554-b53c-134b6d018445" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.310067] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('92032a9b-3873-4554-b53c-134b6d018445',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.448294] env[65065]: INFO networking_nsxv3.common.synchronization [req-2353a18b-3107-40ad-bfbd-9406887f19ca req-2d9cba9b-529b-49e1-8f66-5d1e24c3bfce tempest-MigrationsAdminTest-1843927703 tempest-MigrationsAdminTest-1843927703-project-member] Enqueued Resource ID: 45ff18a7-4a73-49de-af36-6c1d70b047f6 with Priority: HIGHEST for action security_group_members [ 890.449406] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45ff18a7-4a73-49de-af36-6c1d70b047f6 with Priority: HIGHEST for action security_group_members [ 890.449406] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-45ff18a7-4a73-49de-af36-6c1d70b047f6 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.449406] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45ff18a7-4a73-49de-af36-6c1d70b047f6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.449554] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45ff18a7-4a73-49de-af36-6c1d70b047f6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.451069] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45ff18a7-4a73-49de-af36-6c1d70b047f6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.451466] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.451633] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.451719] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.451926] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.452058] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.452195] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('45ff18a7-4a73-49de-af36-6c1d70b047f6',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.466028] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 59251231-0062-455e-a42c-b51620ca89d5 [ 890.466028] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.466028] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.466028] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.466028] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.466028] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.466028] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:59251231-0062-455e-a42c-b51620ca89d5 already deleted. [ 890.466028] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-59251231-0062-455e-a42c-b51620ca89d5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.519272] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1a8690bf-b436-47bf-abed-9ade6d6d5c3f: rpc.has_security_group_logging(os_id): False [ 890.539468] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.539468] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.539468] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.539468] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.539719] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.539751] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.540217] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.540217] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.540217] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.540217] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.540217] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1a8690bf-b436-47bf-abed-9ade6d6d5c3f is going to be created. [ 890.609787] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.609999] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.610063] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.610304] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.610566] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.627162] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1a8690bf-b436-47bf-abed-9ade6d6d5c3f in Status: IN_PROGRESS for 2s [ 890.702552] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1e5f0086-b1e3-4f00-8207-8306f153d0e4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.704143] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e5f0086-b1e3-4f00-8207-8306f153d0e4 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.704143] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.704143] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6cd057ef-479a-4d6e-a5f3-528432c64127 with status ACTIVE [ 890.704366] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.704535] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.704626] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.704842] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.704937] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.705978] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.705978] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.705978] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.705978] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.705978] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.705978] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.705978] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.705978] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.706696] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.706696] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.706696] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6cd057ef-479a-4d6e-a5f3-528432c64127 is going to be updated. [ 890.739469] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.739578] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.739614] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.739804] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.739937] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.740204] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6cd057ef-479a-4d6e-a5f3-528432c64127" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.813956] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 92032a9b-3873-4554-b53c-134b6d018445 [ 890.814193] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.814322] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.814389] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.814632] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.815718] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.815718] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:92032a9b-3873-4554-b53c-134b6d018445 already deleted. [ 890.815718] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-92032a9b-3873-4554-b53c-134b6d018445" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.955151] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.955397] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.955470] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.955770] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.955911] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.957388] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.957388] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.957388] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.957388] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.957388] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.957388] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45ff18a7-4a73-49de-af36-6c1d70b047f6 is going to be updated. [ 890.998025] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.000278] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.000278] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.000278] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.000278] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.015069] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45ff18a7-4a73-49de-af36-6c1d70b047f6 in Status: IN_PROGRESS for 2s [ 891.204648] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1e5f0086-b1e3-4f00-8207-8306f153d0e4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.656152] env[65065]: INFO networking_nsxv3.common.synchronization [None req-9ea83704-0afe-4494-8040-5080b87a28c6 tempest-ServerDiskConfigTestJSON-975440465 tempest-ServerDiskConfigTestJSON-975440465-project-member] Enqueued Resource ID: 21a929c8-df9d-4d4b-8667-6f03a855ff96 with Priority: HIGHEST for action security_group_rules [ 891.656843] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21a929c8-df9d-4d4b-8667-6f03a855ff96 with Priority: HIGHEST for action security_group_rules [ 891.657461] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-21a929c8-df9d-4d4b-8667-6f03a855ff96 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.658144] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-21a929c8-df9d-4d4b-8667-6f03a855ff96" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.658213] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-21a929c8-df9d-4d4b-8667-6f03a855ff96" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.658690] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-21a929c8-df9d-4d4b-8667-6f03a855ff96" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.658791] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('21a929c8-df9d-4d4b-8667-6f03a855ff96',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.708517] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.708517] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.708517] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.708517] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.708809] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.708809] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 is going to be created. [ 891.734577] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.734577] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.734792] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.734825] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.734953] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.745289] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 in Status: UNINITIALIZED for 2s [ 891.801320] env[65065]: INFO networking_nsxv3.common.synchronization [None req-eae5247c-864e-4746-9b55-092d07d49815 tempest-ServerDiskConfigTestJSON-975440465 tempest-ServerDiskConfigTestJSON-975440465-project-member] Enqueued Resource ID: 21a929c8-df9d-4d4b-8667-6f03a855ff96 with Priority: HIGHEST for action security_group_rules [ 891.802116] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21a929c8-df9d-4d4b-8667-6f03a855ff96 with Priority: HIGHEST for action security_group_rules [ 891.802617] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-21a929c8-df9d-4d4b-8667-6f03a855ff96 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.802617] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-21a929c8-df9d-4d4b-8667-6f03a855ff96" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.181059] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.181283] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.181339] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.182171] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.182171] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.182171] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 21a929c8-df9d-4d4b-8667-6f03a855ff96 already deleted. [ 892.182171] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-21a929c8-df9d-4d4b-8667-6f03a855ff96" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.182432] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-21a929c8-df9d-4d4b-8667-6f03a855ff96" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.182724] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-21a929c8-df9d-4d4b-8667-6f03a855ff96" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.182756] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('21a929c8-df9d-4d4b-8667-6f03a855ff96',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.617219] env[65065]: INFO networking_nsxv3.common.synchronization [None req-5ba1b171-7dbf-4f8a-9b01-93834575432a None None] Enqueued Resource ID: 11ed4d11-18ce-4843-b358-622938e94f14 with Priority: HIGHEST for action port [ 892.617650] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11ed4d11-18ce-4843-b358-622938e94f14 with Priority: HIGHEST for action port [ 892.618318] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-11ed4d11-18ce-4843-b358-622938e94f14 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.618601] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-11ed4d11-18ce-4843-b358-622938e94f14" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.618680] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-11ed4d11-18ce-4843-b358-622938e94f14" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.619174] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-11ed4d11-18ce-4843-b358-622938e94f14" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.619270] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('11ed4d11-18ce-4843-b358-622938e94f14',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.639923] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1a8690bf-b436-47bf-abed-9ade6d6d5c3f in Status: SUCCESS [ 892.640480] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1a8690bf-b436-47bf-abed-9ade6d6d5c3f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.706038] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.706411] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.706411] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.706592] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.706685] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.706783] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 21a929c8-df9d-4d4b-8667-6f03a855ff96 already deleted. [ 892.707090] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-21a929c8-df9d-4d4b-8667-6f03a855ff96" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.964784] env[65065]: INFO networking_nsxv3.common.synchronization [None req-af259979-9b88-41b1-a9e5-520ab30d791f None None] Enqueued Resource ID: 53adb75b-7208-47bf-8ee0-a164fe824f6d with Priority: HIGHEST for action port [ 892.965490] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53adb75b-7208-47bf-8ee0-a164fe824f6d with Priority: HIGHEST for action port [ 892.965897] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-53adb75b-7208-47bf-8ee0-a164fe824f6d taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.966321] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-53adb75b-7208-47bf-8ee0-a164fe824f6d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.966481] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-53adb75b-7208-47bf-8ee0-a164fe824f6d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.966821] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-53adb75b-7208-47bf-8ee0-a164fe824f6d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.966958] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('53adb75b-7208-47bf-8ee0-a164fe824f6d',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.028759] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45ff18a7-4a73-49de-af36-6c1d70b047f6 in Status: SUCCESS [ 893.028956] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45ff18a7-4a73-49de-af36-6c1d70b047f6 deletion is rescheduled due to dependency. [ 893.029084] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45ff18a7-4a73-49de-af36-6c1d70b047f6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.122598] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 11ed4d11-18ce-4843-b358-622938e94f14 [ 893.122598] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.122598] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.122598] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.122598] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.122598] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.122598] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:11ed4d11-18ce-4843-b358-622938e94f14 already deleted. [ 893.122598] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-11ed4d11-18ce-4843-b358-622938e94f14" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.472376] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 53adb75b-7208-47bf-8ee0-a164fe824f6d [ 893.472614] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.473194] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.473194] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.473194] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.473194] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.473194] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:53adb75b-7208-47bf-8ee0-a164fe824f6d already deleted. [ 893.473391] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-53adb75b-7208-47bf-8ee0-a164fe824f6d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.758115] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 in Status: SUCCESS [ 893.758463] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.758512] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.758695] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.758887] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.759012] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.759081] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.759309] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.759439] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.759523] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.759590] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1e5f0086-b1e3-4f00-8207-8306f153d0e4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.263896] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e5f0086-b1e3-4f00-8207-8306f153d0e4 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.263896] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.263896] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.264041] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.264333] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.264445] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.264507] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.266063] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.266063] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.266162] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.266325] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e5f0086-b1e3-4f00-8207-8306f153d0e4 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.266424] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.266486] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.266638] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.266911] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.267027] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.267111] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.267259] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.267338] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.267419] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.267507] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1e5f0086-b1e3-4f00-8207-8306f153d0e4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.347257] env[65065]: INFO networking_nsxv3.common.synchronization [req-599245d6-4fad-45c6-bfa8-fb9c57f26526 req-fd3c22f4-6244-4ef4-ba33-616dafe02a2a tempest-ServerActionsTestOtherB-1640131964 tempest-ServerActionsTestOtherB-1640131964-project-member] Enqueued Resource ID: b95b4f27-41f6-4a01-a1aa-aa16348ad807 with Priority: HIGHEST for action security_group_members [ 894.351023] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b95b4f27-41f6-4a01-a1aa-aa16348ad807 with Priority: HIGHEST for action security_group_members [ 894.351023] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-b95b4f27-41f6-4a01-a1aa-aa16348ad807 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.351023] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b95b4f27-41f6-4a01-a1aa-aa16348ad807" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.351023] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b95b4f27-41f6-4a01-a1aa-aa16348ad807" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.351023] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b95b4f27-41f6-4a01-a1aa-aa16348ad807" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.351023] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.351023] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.351023] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.351023] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.351023] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.351023] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b95b4f27-41f6-4a01-a1aa-aa16348ad807',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.772480] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1e5f0086-b1e3-4f00-8207-8306f153d0e4: rpc.has_security_group_logging(os_id): False [ 894.795036] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.795036] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.795036] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.795036] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.795036] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.795036] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.795036] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.795036] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.795036] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.795036] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.796054] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.796379] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.796566] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.796940] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.797188] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.797794] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.798476] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.798476] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.798624] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.798624] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.798748] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 is going to be created. [ 894.852466] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.852712] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.852818] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.853163] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.853237] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.853569] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.853569] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.853702] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.853783] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.853842] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.853917] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b95b4f27-41f6-4a01-a1aa-aa16348ad807 is going to be updated. [ 894.875167] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.876277] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.876277] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.876277] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.876277] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.890817] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 in Status: IN_PROGRESS for 2s [ 894.895514] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.895514] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.895628] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.895769] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.895915] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.907556] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b95b4f27-41f6-4a01-a1aa-aa16348ad807 in Status: IN_PROGRESS for 2s [ 895.412048] env[65065]: INFO networking_nsxv3.common.synchronization [None req-b1841e50-7c12-4c71-92a6-d22e101ac432 None None] Enqueued Resource ID: 19c4207e-fc83-48a4-9d57-2d7e44a08cb3 with Priority: HIGHEST for action port [ 895.412642] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19c4207e-fc83-48a4-9d57-2d7e44a08cb3 with Priority: HIGHEST for action port [ 895.412895] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-19c4207e-fc83-48a4-9d57-2d7e44a08cb3 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.413414] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-19c4207e-fc83-48a4-9d57-2d7e44a08cb3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.413414] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-19c4207e-fc83-48a4-9d57-2d7e44a08cb3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.413414] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-19c4207e-fc83-48a4-9d57-2d7e44a08cb3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.413414] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('19c4207e-fc83-48a4-9d57-2d7e44a08cb3',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.916325] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 19c4207e-fc83-48a4-9d57-2d7e44a08cb3 [ 895.916325] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.916325] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.916762] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.916762] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.916762] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.916762] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:19c4207e-fc83-48a4-9d57-2d7e44a08cb3 already deleted. [ 895.916873] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-19c4207e-fc83-48a4-9d57-2d7e44a08cb3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.908319] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 in Status: SUCCESS [ 896.908600] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.917522] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b95b4f27-41f6-4a01-a1aa-aa16348ad807 in Status: SUCCESS [ 896.917928] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b95b4f27-41f6-4a01-a1aa-aa16348ad807 deletion is rescheduled due to dependency. [ 896.917928] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b95b4f27-41f6-4a01-a1aa-aa16348ad807" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.121167] env[65065]: INFO networking_nsxv3.common.synchronization [req-6eaa9fd3-02c7-4588-8d06-e4b941533e9f req-162bc7a1-5a11-4d91-bb78-842010594922 tempest-ServerDiskConfigTestJSON-975440465 tempest-ServerDiskConfigTestJSON-975440465-project-member] Enqueued Resource ID: ffd44fac-c762-408c-862b-ccea34e00947 with Priority: HIGHEST for action security_group_members [ 898.121938] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ffd44fac-c762-408c-862b-ccea34e00947 with Priority: HIGHEST for action security_group_members [ 898.122361] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-ffd44fac-c762-408c-862b-ccea34e00947 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.122502] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.122557] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.122771] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.123095] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.123095] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.123095] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.123249] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.123337] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.123445] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ffd44fac-c762-408c-862b-ccea34e00947',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.625471] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.625698] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.625698] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.625942] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.626052] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.627110] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.627110] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.627110] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.627110] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.627110] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.627110] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ffd44fac-c762-408c-862b-ccea34e00947 is going to be updated. [ 898.658289] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.658482] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.658558] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.658769] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.658910] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.673813] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ffd44fac-c762-408c-862b-ccea34e00947 in Status: IN_PROGRESS for 2s [ 899.187735] env[65065]: INFO networking_nsxv3.common.synchronization [req-93031628-8cfb-44c2-bcdf-bd5e11f29d39 req-5fa7740e-9d3f-437b-9a45-5420a0f1ddf2 tempest-FloatingIPsAssociationNegativeTestJSON-103735492 tempest-FloatingIPsAssociationNegativeTestJSON-103735492-project-member] Enqueued Resource ID: 386d96b4-ccad-4c04-8bda-534b3f25dc91 with Priority: HIGHEST for action security_group_members [ 899.188353] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 386d96b4-ccad-4c04-8bda-534b3f25dc91 with Priority: HIGHEST for action security_group_members [ 899.189395] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-386d96b4-ccad-4c04-8bda-534b3f25dc91 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.189395] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-386d96b4-ccad-4c04-8bda-534b3f25dc91" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.189904] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-386d96b4-ccad-4c04-8bda-534b3f25dc91" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.190203] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-386d96b4-ccad-4c04-8bda-534b3f25dc91" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.190382] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.190485] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.190547] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.190709] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.190793] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.190887] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('386d96b4-ccad-4c04-8bda-534b3f25dc91',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.335684] env[65065]: INFO networking_nsxv3.common.synchronization [None req-038c0e7f-31c0-4528-b326-2f03b3b7e27a tempest-AttachInterfacesTestJSON-1590270829 tempest-AttachInterfacesTestJSON-1590270829-project-member] Enqueued Resource ID: cce60a92-c34e-445e-97a5-b8cfceb8b2b3 with Priority: HIGHEST for action security_group_rules [ 899.336401] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cce60a92-c34e-445e-97a5-b8cfceb8b2b3 with Priority: HIGHEST for action security_group_rules [ 899.336889] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cce60a92-c34e-445e-97a5-b8cfceb8b2b3 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.336956] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cce60a92-c34e-445e-97a5-b8cfceb8b2b3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.337019] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cce60a92-c34e-445e-97a5-b8cfceb8b2b3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.337282] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cce60a92-c34e-445e-97a5-b8cfceb8b2b3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.337368] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cce60a92-c34e-445e-97a5-b8cfceb8b2b3',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.594343] env[65065]: INFO networking_nsxv3.common.synchronization [None req-228e1336-4994-4864-aed6-9ee7f635b61d tempest-AttachInterfacesTestJSON-1590270829 tempest-AttachInterfacesTestJSON-1590270829-project-member] Enqueued Resource ID: cce60a92-c34e-445e-97a5-b8cfceb8b2b3 with Priority: HIGHEST for action security_group_rules [ 899.595900] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cce60a92-c34e-445e-97a5-b8cfceb8b2b3 with Priority: HIGHEST for action security_group_rules [ 899.596452] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cce60a92-c34e-445e-97a5-b8cfceb8b2b3 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.596758] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cce60a92-c34e-445e-97a5-b8cfceb8b2b3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.622907] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock network-886 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.623111] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "network-886" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.623244] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "network-886" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.623572] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "network-886" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.623825] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.624149] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.624324] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.625114] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.625114] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.625114] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 899.625287] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 899.625287] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 899.625382] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 899.625496] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 899.625631] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 899.625766] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 899.647339] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 899.647570] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 899.647736] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 899.647976] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "network-886" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.648431] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock port-acc2b7d4-40ca-4761-996b-14c73f4fb16c taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.648891] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "port-acc2b7d4-40ca-4761-996b-14c73f4fb16c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.648891] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "port-acc2b7d4-40ca-4761-996b-14c73f4fb16c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.649325] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "port-acc2b7d4-40ca-4761-996b-14c73f4fb16c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.649507] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('acc2b7d4-40ca-4761-996b-14c73f4fb16c',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.693233] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.693379] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.693458] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.693978] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.693978] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.694119] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.694205] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.694205] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.694378] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.694483] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.694605] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 386d96b4-ccad-4c04-8bda-534b3f25dc91 already deleted. [ 899.694696] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-386d96b4-ccad-4c04-8bda-534b3f25dc91" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.857529] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.857704] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.857758] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.858173] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.858272] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.858370] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cce60a92-c34e-445e-97a5-b8cfceb8b2b3 already deleted. [ 899.858458] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cce60a92-c34e-445e-97a5-b8cfceb8b2b3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.858623] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cce60a92-c34e-445e-97a5-b8cfceb8b2b3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.858791] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cce60a92-c34e-445e-97a5-b8cfceb8b2b3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.858875] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cce60a92-c34e-445e-97a5-b8cfceb8b2b3',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.153448] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.153677] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.153823] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.154149] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.154303] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.154455] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Segment Port acc2b7d4-40ca-4761-996b-14c73f4fb16c not found, creating... [ 900.154724] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.154882] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.155011] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.155345] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.155542] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.155905] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.156172] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.156352] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.156583] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.156790] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.156938] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Resource: SegmentPort with ID: acc2b7d4-40ca-4761-996b-14c73f4fb16c is going to be created. [ 900.179423] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.179653] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.179856] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.180154] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.180410] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.180640] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "port-acc2b7d4-40ca-4761-996b-14c73f4fb16c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.381431] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.381431] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.381431] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.381431] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.381431] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.381431] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cce60a92-c34e-445e-97a5-b8cfceb8b2b3 already deleted. [ 900.381431] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cce60a92-c34e-445e-97a5-b8cfceb8b2b3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.684955] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ffd44fac-c762-408c-862b-ccea34e00947 in Status: SUCCESS [ 900.684955] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ffd44fac-c762-408c-862b-ccea34e00947 deletion is rescheduled due to dependency. [ 900.684955] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.907090] env[65065]: INFO networking_nsxv3.common.synchronization [req-93031628-8cfb-44c2-bcdf-bd5e11f29d39 req-247cedc0-b3d7-48fc-a9b3-8e531428a9b0 service nova] Enqueued Resource ID: 386d96b4-ccad-4c04-8bda-534b3f25dc91 with Priority: HIGHEST for action security_group_rules [ 900.907090] env[65065]: INFO networking_nsxv3.common.synchronization [req-93031628-8cfb-44c2-bcdf-bd5e11f29d39 req-247cedc0-b3d7-48fc-a9b3-8e531428a9b0 service nova] Enqueued Resource ID: 386d96b4-ccad-4c04-8bda-534b3f25dc91 with Priority: HIGHEST for action security_group_members [ 900.907090] env[65065]: INFO networking_nsxv3.common.synchronization [req-93031628-8cfb-44c2-bcdf-bd5e11f29d39 req-247cedc0-b3d7-48fc-a9b3-8e531428a9b0 service nova] Enqueued Resource ID: acc2b7d4-40ca-4761-996b-14c73f4fb16c with Priority: HIGHEST for action port [ 900.907494] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 386d96b4-ccad-4c04-8bda-534b3f25dc91 with Priority: HIGHEST for action security_group_rules [ 900.907627] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 386d96b4-ccad-4c04-8bda-534b3f25dc91 with Priority: HIGHEST for action security_group_members [ 900.907724] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: acc2b7d4-40ca-4761-996b-14c73f4fb16c with Priority: HIGHEST for action port [ 900.907997] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-386d96b4-ccad-4c04-8bda-534b3f25dc91 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.909015] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-386d96b4-ccad-4c04-8bda-534b3f25dc91" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.909153] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-386d96b4-ccad-4c04-8bda-534b3f25dc91" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.909468] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-386d96b4-ccad-4c04-8bda-534b3f25dc91" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.909808] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('386d96b4-ccad-4c04-8bda-534b3f25dc91',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.912346] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-386d96b4-ccad-4c04-8bda-534b3f25dc91 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.912528] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-386d96b4-ccad-4c04-8bda-534b3f25dc91" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.912642] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-386d96b4-ccad-4c04-8bda-534b3f25dc91" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.912902] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-386d96b4-ccad-4c04-8bda-534b3f25dc91" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.914977] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.916266] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.916406] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.916788] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.917073] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.918028] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('386d96b4-ccad-4c04-8bda-534b3f25dc91',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.918782] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-acc2b7d4-40ca-4761-996b-14c73f4fb16c taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.918782] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-acc2b7d4-40ca-4761-996b-14c73f4fb16c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.918782] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-acc2b7d4-40ca-4761-996b-14c73f4fb16c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.919426] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-acc2b7d4-40ca-4761-996b-14c73f4fb16c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.919571] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('acc2b7d4-40ca-4761-996b-14c73f4fb16c',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.421652] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('386d96b4-ccad-4c04-8bda-534b3f25dc91',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.422697] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-386d96b4-ccad-4c04-8bda-534b3f25dc91 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.422805] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-386d96b4-ccad-4c04-8bda-534b3f25dc91" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.422956] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port acc2b7d4-40ca-4761-996b-14c73f4fb16c with status ACTIVE [ 901.423116] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.424023] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.424023] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.424023] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.424023] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.424023] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.424023] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.424023] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.424023] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.425420] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.425420] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.425420] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.425580] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.427046] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.427046] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.427046] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: acc2b7d4-40ca-4761-996b-14c73f4fb16c is going to be updated. [ 901.450689] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.450689] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.450846] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.450941] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.451064] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.451225] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-acc2b7d4-40ca-4761-996b-14c73f4fb16c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.927757] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('386d96b4-ccad-4c04-8bda-534b3f25dc91',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.279281] env[65065]: INFO networking_nsxv3.common.synchronization [None req-7e617966-286c-463b-9df2-d7aeb5e15a7f None None] Enqueued Resource ID: af2bf9c8-6447-4ddb-b23a-f653c85d0e50 with Priority: HIGHEST for action port [ 902.279281] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af2bf9c8-6447-4ddb-b23a-f653c85d0e50 with Priority: HIGHEST for action port [ 902.279730] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-af2bf9c8-6447-4ddb-b23a-f653c85d0e50 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.279845] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-af2bf9c8-6447-4ddb-b23a-f653c85d0e50" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.279913] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-af2bf9c8-6447-4ddb-b23a-f653c85d0e50" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.280366] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-af2bf9c8-6447-4ddb-b23a-f653c85d0e50" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.280462] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('af2bf9c8-6447-4ddb-b23a-f653c85d0e50',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.434280] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.434601] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.434601] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.434708] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.434796] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.434891] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 386d96b4-ccad-4c04-8bda-534b3f25dc91 is going to be created. [ 902.463341] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.463497] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.463584] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.463958] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.463958] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.474938] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 386d96b4-ccad-4c04-8bda-534b3f25dc91 in Status: UNINITIALIZED for 2s [ 902.782605] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port af2bf9c8-6447-4ddb-b23a-f653c85d0e50 [ 902.782844] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.782974] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.783053] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.783275] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.783355] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.783445] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:af2bf9c8-6447-4ddb-b23a-f653c85d0e50 already deleted. [ 902.783525] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-af2bf9c8-6447-4ddb-b23a-f653c85d0e50" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.402754] env[65065]: INFO networking_nsxv3.common.synchronization [None req-c04d5b94-237b-4a05-86a9-cdee590f5397 tempest-AttachInterfacesUnderV243Test-339300557 tempest-AttachInterfacesUnderV243Test-339300557-project-member] Enqueued Resource ID: edcd6c4a-2692-4c72-ae97-49015334375d with Priority: HIGHEST for action security_group_rules [ 903.404219] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: edcd6c4a-2692-4c72-ae97-49015334375d with Priority: HIGHEST for action security_group_rules [ 903.404219] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-edcd6c4a-2692-4c72-ae97-49015334375d taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.404219] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-edcd6c4a-2692-4c72-ae97-49015334375d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.404219] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-edcd6c4a-2692-4c72-ae97-49015334375d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.406178] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-edcd6c4a-2692-4c72-ae97-49015334375d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.406271] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('edcd6c4a-2692-4c72-ae97-49015334375d',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.527624] env[65065]: INFO networking_nsxv3.common.synchronization [None req-12feeaac-6ddc-4cd2-8bb1-5b5f9d5f62f5 tempest-AttachInterfacesUnderV243Test-339300557 tempest-AttachInterfacesUnderV243Test-339300557-project-member] Enqueued Resource ID: edcd6c4a-2692-4c72-ae97-49015334375d with Priority: HIGHEST for action security_group_rules [ 903.528246] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: edcd6c4a-2692-4c72-ae97-49015334375d with Priority: HIGHEST for action security_group_rules [ 903.528621] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-edcd6c4a-2692-4c72-ae97-49015334375d taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.528711] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-edcd6c4a-2692-4c72-ae97-49015334375d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.934628] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.934628] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.934628] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.934628] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.934628] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.934628] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: edcd6c4a-2692-4c72-ae97-49015334375d already deleted. [ 903.934628] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-edcd6c4a-2692-4c72-ae97-49015334375d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.934628] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-edcd6c4a-2692-4c72-ae97-49015334375d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.934974] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-edcd6c4a-2692-4c72-ae97-49015334375d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.935819] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('edcd6c4a-2692-4c72-ae97-49015334375d',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.456745] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.457028] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.457098] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.457468] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.457567] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.457675] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: edcd6c4a-2692-4c72-ae97-49015334375d already deleted. [ 904.457765] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-edcd6c4a-2692-4c72-ae97-49015334375d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.488325] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 386d96b4-ccad-4c04-8bda-534b3f25dc91 in Status: SUCCESS [ 904.488543] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-386d96b4-ccad-4c04-8bda-534b3f25dc91" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.488712] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-386d96b4-ccad-4c04-8bda-534b3f25dc91" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.488943] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-386d96b4-ccad-4c04-8bda-534b3f25dc91" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.489147] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.489289] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.489359] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.489516] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.489624] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.489713] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-386d96b4-ccad-4c04-8bda-534b3f25dc91" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.489763] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('386d96b4-ccad-4c04-8bda-534b3f25dc91',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.951581] env[65065]: INFO networking_nsxv3.common.synchronization [None req-9822d110-dffc-4d8e-98e8-67b07176b184 None None] Enqueued Resource ID: 91ade78a-e561-4c7e-af77-21705d57becc with Priority: HIGHEST for action port [ 904.952275] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 91ade78a-e561-4c7e-af77-21705d57becc with Priority: HIGHEST for action port [ 904.952653] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-91ade78a-e561-4c7e-af77-21705d57becc taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.952826] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-91ade78a-e561-4c7e-af77-21705d57becc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.952973] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-91ade78a-e561-4c7e-af77-21705d57becc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.953281] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-91ade78a-e561-4c7e-af77-21705d57becc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.953575] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('91ade78a-e561-4c7e-af77-21705d57becc',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.993335] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-386d96b4-ccad-4c04-8bda-534b3f25dc91 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.993579] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-386d96b4-ccad-4c04-8bda-534b3f25dc91" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.993657] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-386d96b4-ccad-4c04-8bda-534b3f25dc91" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.993873] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-386d96b4-ccad-4c04-8bda-534b3f25dc91" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.994048] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.994216] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.994216] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.994451] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.994569] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.994569] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-386d96b4-ccad-4c04-8bda-534b3f25dc91" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.994713] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-386d96b4-ccad-4c04-8bda-534b3f25dc91 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.994813] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-386d96b4-ccad-4c04-8bda-534b3f25dc91" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.994872] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-386d96b4-ccad-4c04-8bda-534b3f25dc91" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.995026] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-386d96b4-ccad-4c04-8bda-534b3f25dc91" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.995158] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.995249] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.995315] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.995621] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.995791] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.995956] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-386d96b4-ccad-4c04-8bda-534b3f25dc91" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.996076] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('386d96b4-ccad-4c04-8bda-534b3f25dc91',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.456725] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 91ade78a-e561-4c7e-af77-21705d57becc [ 905.456725] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.456725] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.456725] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.456725] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.456725] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.456725] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:91ade78a-e561-4c7e-af77-21705d57becc already deleted. [ 905.456725] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-91ade78a-e561-4c7e-af77-21705d57becc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.499059] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 386d96b4-ccad-4c04-8bda-534b3f25dc91: rpc.has_security_group_logging(os_id): False [ 905.520963] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.520963] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.520963] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.521393] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.521393] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.521793] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.521793] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.521793] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.521793] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.521970] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.522568] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.522568] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.522568] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.522568] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.522568] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.522815] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.522815] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.522815] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.522959] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.524187] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.524187] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 386d96b4-ccad-4c04-8bda-534b3f25dc91 is going to be created. [ 905.591599] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.591599] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.591599] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.591869] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.592144] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.608189] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 386d96b4-ccad-4c04-8bda-534b3f25dc91 in Status: IN_PROGRESS for 2s [ 906.981655] env[65065]: INFO networking_nsxv3.common.synchronization [req-9fdd61e2-5fbb-40ed-b13f-d755fbc8252a req-93afdecc-0de5-4449-aeb8-5ec2fdad8c33 tempest-ListServerFiltersTestJSON-2126051990 tempest-ListServerFiltersTestJSON-2126051990-project-member] Enqueued Resource ID: b36fec68-8054-450e-a4b6-c700b29fd114 with Priority: HIGHEST for action security_group_members [ 906.982312] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b36fec68-8054-450e-a4b6-c700b29fd114 with Priority: HIGHEST for action security_group_members [ 906.982701] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-b36fec68-8054-450e-a4b6-c700b29fd114 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.982790] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b36fec68-8054-450e-a4b6-c700b29fd114" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.982790] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b36fec68-8054-450e-a4b6-c700b29fd114" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.987033] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b36fec68-8054-450e-a4b6-c700b29fd114" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.987033] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.987033] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.987033] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.987033] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.987033] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.987033] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b36fec68-8054-450e-a4b6-c700b29fd114',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.487297] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b36fec68-8054-450e-a4b6-c700b29fd114',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.621387] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 386d96b4-ccad-4c04-8bda-534b3f25dc91 in Status: SUCCESS [ 907.621516] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-386d96b4-ccad-4c04-8bda-534b3f25dc91" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.990431] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b36fec68-8054-450e-a4b6-c700b29fd114',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.389716] env[65065]: INFO networking_nsxv3.common.synchronization [req-dde1ee4b-338f-4b6d-84ef-bdf43fe2544d req-6274d2a5-9b19-4d33-9051-de68d59ff5a6 tempest-ImagesOneServerNegativeTestJSON-764093247 tempest-ImagesOneServerNegativeTestJSON-764093247-project-member] Enqueued Resource ID: 9ed22036-e9a4-4639-89b9-c743ca686b09 with Priority: HIGHEST for action security_group_members [ 908.390280] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ed22036-e9a4-4639-89b9-c743ca686b09 with Priority: HIGHEST for action security_group_members [ 908.390590] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ed22036-e9a4-4639-89b9-c743ca686b09 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.390709] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ed22036-e9a4-4639-89b9-c743ca686b09" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.390775] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ed22036-e9a4-4639-89b9-c743ca686b09" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.390966] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ed22036-e9a4-4639-89b9-c743ca686b09" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.394068] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.394184] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.394305] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.394560] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.394658] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.394759] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ed22036-e9a4-4639-89b9-c743ca686b09',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.492676] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.492676] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.492979] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.492979] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.493139] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.493267] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b36fec68-8054-450e-a4b6-c700b29fd114 is going to be updated. [ 908.527756] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.528094] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.528094] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.528483] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.528483] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.540621] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b36fec68-8054-450e-a4b6-c700b29fd114 in Status: IN_PROGRESS for 2s [ 908.764188] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock network-105 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.764438] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "network-105" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.764597] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "network-105" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.764898] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "network-105" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.765202] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.765408] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.765539] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.765757] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.765924] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.766177] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 908.766293] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 908.766412] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 908.766507] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 908.766613] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 908.766714] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 908.766841] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 908.786355] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 908.786550] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 908.786691] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 908.786865] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "network-105" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.787257] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock port-02f14212-f2ab-4ca1-a538-32a7cf311716 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.787406] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "port-02f14212-f2ab-4ca1-a538-32a7cf311716" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.787524] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "port-02f14212-f2ab-4ca1-a538-32a7cf311716" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.787855] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "port-02f14212-f2ab-4ca1-a538-32a7cf311716" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.788048] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('02f14212-f2ab-4ca1-a538-32a7cf311716',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.898998] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.899181] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.899273] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.899538] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.899673] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.899882] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.899982] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.900072] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.900267] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.900345] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.900439] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ed22036-e9a4-4639-89b9-c743ca686b09 is going to be updated. [ 908.935911] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.936121] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.936157] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.936346] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.936485] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.945531] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ed22036-e9a4-4639-89b9-c743ca686b09 in Status: IN_PROGRESS for 2s [ 909.290413] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.290787] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.290831] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.291091] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.291238] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.291391] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Segment Port 02f14212-f2ab-4ca1-a538-32a7cf311716 not found, creating... [ 909.291737] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.291899] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.292031] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.292251] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.292385] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.292660] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.292812] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.292924] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.293234] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.293316] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.293453] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Resource: SegmentPort with ID: 02f14212-f2ab-4ca1-a538-32a7cf311716 is going to be created. [ 909.315491] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.315722] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.315845] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.316171] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.316402] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.316632] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "port-02f14212-f2ab-4ca1-a538-32a7cf311716" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.028962] env[65065]: INFO networking_nsxv3.common.synchronization [req-dde1ee4b-338f-4b6d-84ef-bdf43fe2544d req-b4e72664-97fa-4c0a-9a52-61d9d889f5e8 service nova] Enqueued Resource ID: 9ed22036-e9a4-4639-89b9-c743ca686b09 with Priority: HIGHEST for action security_group_rules [ 910.029171] env[65065]: INFO networking_nsxv3.common.synchronization [req-dde1ee4b-338f-4b6d-84ef-bdf43fe2544d req-b4e72664-97fa-4c0a-9a52-61d9d889f5e8 service nova] Enqueued Resource ID: 9ed22036-e9a4-4639-89b9-c743ca686b09 with Priority: HIGHEST for action security_group_members [ 910.029367] env[65065]: INFO networking_nsxv3.common.synchronization [req-dde1ee4b-338f-4b6d-84ef-bdf43fe2544d req-b4e72664-97fa-4c0a-9a52-61d9d889f5e8 service nova] Enqueued Resource ID: 02f14212-f2ab-4ca1-a538-32a7cf311716 with Priority: HIGHEST for action port [ 910.029879] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ed22036-e9a4-4639-89b9-c743ca686b09 with Priority: HIGHEST for action security_group_rules [ 910.030349] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ed22036-e9a4-4639-89b9-c743ca686b09 with Priority: HIGHEST for action security_group_members [ 910.030539] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02f14212-f2ab-4ca1-a538-32a7cf311716 with Priority: HIGHEST for action port [ 910.030869] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9ed22036-e9a4-4639-89b9-c743ca686b09 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.031057] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9ed22036-e9a4-4639-89b9-c743ca686b09" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.031148] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9ed22036-e9a4-4639-89b9-c743ca686b09" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.031371] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9ed22036-e9a4-4639-89b9-c743ca686b09" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.031477] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9ed22036-e9a4-4639-89b9-c743ca686b09',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.032577] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ed22036-e9a4-4639-89b9-c743ca686b09 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.032746] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ed22036-e9a4-4639-89b9-c743ca686b09" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.032945] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-02f14212-f2ab-4ca1-a538-32a7cf311716 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.033086] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-02f14212-f2ab-4ca1-a538-32a7cf311716" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.033176] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-02f14212-f2ab-4ca1-a538-32a7cf311716" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.033442] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-02f14212-f2ab-4ca1-a538-32a7cf311716" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.033546] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('02f14212-f2ab-4ca1-a538-32a7cf311716',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.536339] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ed22036-e9a4-4639-89b9-c743ca686b09 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.536794] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ed22036-e9a4-4639-89b9-c743ca686b09" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.536794] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 02f14212-f2ab-4ca1-a538-32a7cf311716 with status ACTIVE [ 910.537077] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.537236] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.537395] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.537548] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.537691] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.537888] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.537988] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.538061] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.538225] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.538305] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.538500] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.538587] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.538650] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.538785] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.538857] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.538937] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 02f14212-f2ab-4ca1-a538-32a7cf311716 is going to be updated. [ 910.550388] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b36fec68-8054-450e-a4b6-c700b29fd114 in Status: SUCCESS [ 910.550597] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b36fec68-8054-450e-a4b6-c700b29fd114" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.561452] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.561632] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.561675] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.561890] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.562034] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.562201] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-02f14212-f2ab-4ca1-a538-32a7cf311716" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.903942] env[65065]: INFO networking_nsxv3.common.synchronization [req-6c41327e-bc8e-46fd-aaeb-354476c1bfc9 req-8875a074-5cf1-4b21-9def-cffbdf58f32e tempest-ImagesTestJSON-1714479415 tempest-ImagesTestJSON-1714479415-project-member] Enqueued Resource ID: e6d7baac-4bff-46b9-b88d-2dc982621c0f with Priority: HIGHEST for action security_group_members [ 910.904695] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6d7baac-4bff-46b9-b88d-2dc982621c0f with Priority: HIGHEST for action security_group_members [ 910.906934] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6d7baac-4bff-46b9-b88d-2dc982621c0f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.907094] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.907335] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.907829] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.908022] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.908134] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.908200] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.908362] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.908450] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.908589] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e6d7baac-4bff-46b9-b88d-2dc982621c0f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.956171] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ed22036-e9a4-4639-89b9-c743ca686b09 in Status: SUCCESS [ 910.956362] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ed22036-e9a4-4639-89b9-c743ca686b09 deletion is rescheduled due to dependency. [ 910.956475] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ed22036-e9a4-4639-89b9-c743ca686b09" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.956634] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ed22036-e9a4-4639-89b9-c743ca686b09" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.956858] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ed22036-e9a4-4639-89b9-c743ca686b09" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.957078] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.957202] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.957289] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.957437] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.957520] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.957616] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ed22036-e9a4-4639-89b9-c743ca686b09',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.258116] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock network-582 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.258304] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "network-582" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.258425] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "network-582" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.258691] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "network-582" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.258938] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.259105] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.259223] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.259470] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.259613] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.259816] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 911.259928] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 911.260051] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 911.260214] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 911.260370] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 911.260487] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 911.260616] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 911.278723] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 911.278942] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 911.279105] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 911.279327] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "network-582" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.279666] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock port-5289e90c-a3e8-406b-9747-fe96b4f9d84f taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.279824] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "port-5289e90c-a3e8-406b-9747-fe96b4f9d84f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.279939] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "port-5289e90c-a3e8-406b-9747-fe96b4f9d84f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.280304] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "port-5289e90c-a3e8-406b-9747-fe96b4f9d84f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.280450] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5289e90c-a3e8-406b-9747-fe96b4f9d84f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.412593] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.412593] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.412593] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.412593] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.412593] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.412593] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.412593] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.412593] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.412593] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.412593] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.412593] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6d7baac-4bff-46b9-b88d-2dc982621c0f is going to be updated. [ 911.439767] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.439910] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.441681] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.441681] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.441681] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.449459] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6d7baac-4bff-46b9-b88d-2dc982621c0f in Status: IN_PROGRESS for 2s [ 911.465160] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9ed22036-e9a4-4639-89b9-c743ca686b09',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.783201] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.783666] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.783666] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.783927] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.784098] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.784611] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Segment Port 5289e90c-a3e8-406b-9747-fe96b4f9d84f not found, creating... [ 911.784611] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.784763] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.784864] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.785150] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.785332] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.785650] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.785812] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.785958] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.786185] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.786341] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.786481] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Resource: SegmentPort with ID: 5289e90c-a3e8-406b-9747-fe96b4f9d84f is going to be created. [ 911.819933] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.820151] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.820311] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.820606] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.820849] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.821161] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "port-5289e90c-a3e8-406b-9747-fe96b4f9d84f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.966023] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9ed22036-e9a4-4639-89b9-c743ca686b09',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.468519] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.468728] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.468807] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.469034] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.469147] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.469314] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ed22036-e9a4-4639-89b9-c743ca686b09 is going to be updated. [ 912.499666] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.499854] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.499895] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.500173] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.500363] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.517949] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ed22036-e9a4-4639-89b9-c743ca686b09 in Status: IN_PROGRESS for 2s [ 912.528084] env[65065]: INFO networking_nsxv3.common.synchronization [req-6c41327e-bc8e-46fd-aaeb-354476c1bfc9 req-e35a951a-9197-45cd-966b-7b1c69395128 service nova] Enqueued Resource ID: e6d7baac-4bff-46b9-b88d-2dc982621c0f with Priority: HIGHEST for action security_group_rules [ 912.528310] env[65065]: INFO networking_nsxv3.common.synchronization [req-6c41327e-bc8e-46fd-aaeb-354476c1bfc9 req-e35a951a-9197-45cd-966b-7b1c69395128 service nova] Enqueued Resource ID: e6d7baac-4bff-46b9-b88d-2dc982621c0f with Priority: HIGHEST for action security_group_members [ 912.528457] env[65065]: INFO networking_nsxv3.common.synchronization [req-6c41327e-bc8e-46fd-aaeb-354476c1bfc9 req-e35a951a-9197-45cd-966b-7b1c69395128 service nova] Enqueued Resource ID: 5289e90c-a3e8-406b-9747-fe96b4f9d84f with Priority: HIGHEST for action port [ 912.531315] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6d7baac-4bff-46b9-b88d-2dc982621c0f with Priority: HIGHEST for action security_group_rules [ 912.531315] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6d7baac-4bff-46b9-b88d-2dc982621c0f with Priority: HIGHEST for action security_group_members [ 912.531315] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5289e90c-a3e8-406b-9747-fe96b4f9d84f with Priority: HIGHEST for action port [ 912.531315] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e6d7baac-4bff-46b9-b88d-2dc982621c0f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.531315] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.531315] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.531315] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.531315] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e6d7baac-4bff-46b9-b88d-2dc982621c0f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.531957] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6d7baac-4bff-46b9-b88d-2dc982621c0f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.532065] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.533553] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-5289e90c-a3e8-406b-9747-fe96b4f9d84f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.533553] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5289e90c-a3e8-406b-9747-fe96b4f9d84f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.533553] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5289e90c-a3e8-406b-9747-fe96b4f9d84f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.533553] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5289e90c-a3e8-406b-9747-fe96b4f9d84f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.533553] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5289e90c-a3e8-406b-9747-fe96b4f9d84f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.034485] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6d7baac-4bff-46b9-b88d-2dc982621c0f taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.035040] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.035040] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5289e90c-a3e8-406b-9747-fe96b4f9d84f with status ACTIVE [ 913.035040] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.035289] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.035289] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.035500] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.035500] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.035608] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.035795] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.035795] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.035887] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.035933] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.036126] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.036225] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.036275] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.036406] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.036480] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.036561] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5289e90c-a3e8-406b-9747-fe96b4f9d84f is going to be updated. [ 913.062770] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.063993] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.063993] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.063993] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.063993] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.063993] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5289e90c-a3e8-406b-9747-fe96b4f9d84f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.461687] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6d7baac-4bff-46b9-b88d-2dc982621c0f in Status: SUCCESS [ 913.461876] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6d7baac-4bff-46b9-b88d-2dc982621c0f deletion is rescheduled due to dependency. [ 913.461993] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.462177] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.462578] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.462578] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.462736] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.462736] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.462905] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.462954] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.463064] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e6d7baac-4bff-46b9-b88d-2dc982621c0f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.964873] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e6d7baac-4bff-46b9-b88d-2dc982621c0f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.469068] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e6d7baac-4bff-46b9-b88d-2dc982621c0f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.531449] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ed22036-e9a4-4639-89b9-c743ca686b09 in Status: SUCCESS [ 914.531734] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ed22036-e9a4-4639-89b9-c743ca686b09" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.531913] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ed22036-e9a4-4639-89b9-c743ca686b09" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.532151] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ed22036-e9a4-4639-89b9-c743ca686b09" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.532344] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.532463] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.532542] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.532709] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.532805] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.532937] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ed22036-e9a4-4639-89b9-c743ca686b09" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.533015] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9ed22036-e9a4-4639-89b9-c743ca686b09',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.971574] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.971717] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.971791] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.972012] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.972109] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.972230] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6d7baac-4bff-46b9-b88d-2dc982621c0f is going to be updated. [ 915.000880] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.001215] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.001215] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.001393] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.001494] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.012768] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6d7baac-4bff-46b9-b88d-2dc982621c0f in Status: IN_PROGRESS for 2s [ 915.037581] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ed22036-e9a4-4639-89b9-c743ca686b09 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.037745] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ed22036-e9a4-4639-89b9-c743ca686b09" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.037817] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ed22036-e9a4-4639-89b9-c743ca686b09" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.038048] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ed22036-e9a4-4639-89b9-c743ca686b09" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.038212] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.038313] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.038378] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.038529] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.038612] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.038698] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ed22036-e9a4-4639-89b9-c743ca686b09" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.038960] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ed22036-e9a4-4639-89b9-c743ca686b09 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.038960] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ed22036-e9a4-4639-89b9-c743ca686b09" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.039125] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ed22036-e9a4-4639-89b9-c743ca686b09" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.039125] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ed22036-e9a4-4639-89b9-c743ca686b09" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.039423] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.040057] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.040178] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.040413] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.040413] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.040506] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ed22036-e9a4-4639-89b9-c743ca686b09" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.040659] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9ed22036-e9a4-4639-89b9-c743ca686b09',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.549955] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9ed22036-e9a4-4639-89b9-c743ca686b09: rpc.has_security_group_logging(os_id): False [ 915.569744] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.569910] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.570040] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.570192] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.570350] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.570619] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.570724] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.570865] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.570939] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.571023] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.571395] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.571395] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.571395] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.571778] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.571778] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.571778] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.572299] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.572299] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.572299] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.573172] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.573390] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9ed22036-e9a4-4639-89b9-c743ca686b09 is going to be updated. [ 915.633805] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.635646] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.635777] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.636770] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.637301] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.654495] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9ed22036-e9a4-4639-89b9-c743ca686b09 in Status: IN_PROGRESS for 2s [ 917.028604] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6d7baac-4bff-46b9-b88d-2dc982621c0f in Status: SUCCESS [ 917.028927] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.032716] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.032716] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.033549] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.033549] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.033549] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.033549] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.033549] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.033549] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.033549] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e6d7baac-4bff-46b9-b88d-2dc982621c0f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.533406] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 917.533524] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 917.538174] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6d7baac-4bff-46b9-b88d-2dc982621c0f taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.538174] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.538174] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.538174] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.538174] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.538174] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.538644] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.538644] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.538755] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.538804] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.538961] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6d7baac-4bff-46b9-b88d-2dc982621c0f taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.539065] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.539194] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.539446] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.539588] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.539690] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.539745] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.539876] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.539949] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.540044] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.540163] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e6d7baac-4bff-46b9-b88d-2dc982621c0f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.672337] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9ed22036-e9a4-4639-89b9-c743ca686b09 in Status: SUCCESS [ 917.675021] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9ed22036-e9a4-4639-89b9-c743ca686b09" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.904017] env[65065]: INFO networking_nsxv3.common.synchronization [req-544aa606-553c-4c5e-9cbc-2c368899fbd5 req-ac1b82c5-0c60-44f0-91a0-24bddd4bd4f3 tempest-ServerMetadataNegativeTestJSON-504279798 tempest-ServerMetadataNegativeTestJSON-504279798-project-member] Enqueued Resource ID: 764b0b91-9c29-4261-b801-b1e924956192 with Priority: HIGHEST for action security_group_members [ 917.904155] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 764b0b91-9c29-4261-b801-b1e924956192 with Priority: HIGHEST for action security_group_members [ 917.904531] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-764b0b91-9c29-4261-b801-b1e924956192 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.904600] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-764b0b91-9c29-4261-b801-b1e924956192" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.904672] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-764b0b91-9c29-4261-b801-b1e924956192" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.905140] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-764b0b91-9c29-4261-b801-b1e924956192" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.906086] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.906086] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.906086] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.906086] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.906086] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.906086] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('764b0b91-9c29-4261-b801-b1e924956192',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.042881] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e6d7baac-4bff-46b9-b88d-2dc982621c0f: rpc.has_security_group_logging(os_id): False [ 918.062385] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.062603] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.062678] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.062929] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.063042] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.063259] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.063357] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.063666] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.063666] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.063666] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.063788] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.063883] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.063943] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.064149] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.064226] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.064413] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.064505] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.064566] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.064703] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.064774] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.064920] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e6d7baac-4bff-46b9-b88d-2dc982621c0f is going to be updated. [ 918.142845] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.143026] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.143093] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.143293] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.143433] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.158766] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e6d7baac-4bff-46b9-b88d-2dc982621c0f in Status: IN_PROGRESS for 2s [ 918.321322] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock network-111 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.321777] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "network-111" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.321777] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "network-111" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.323152] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "network-111" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.323152] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.323152] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.323152] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.323152] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.323152] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.323622] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 918.323622] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 918.323742] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 918.323794] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 918.323918] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 918.324024] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 918.324116] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 918.349508] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 918.349748] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 918.349900] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 918.350089] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "network-111" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.350490] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock port-4d6ed0f0-d40a-43e5-8dde-071620e70b3c taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.350701] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "port-4d6ed0f0-d40a-43e5-8dde-071620e70b3c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.350868] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "port-4d6ed0f0-d40a-43e5-8dde-071620e70b3c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.351286] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "port-4d6ed0f0-d40a-43e5-8dde-071620e70b3c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.351442] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4d6ed0f0-d40a-43e5-8dde-071620e70b3c',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.409092] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.409092] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.409327] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.409801] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.409978] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.410364] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.410549] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.410627] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.410830] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.410919] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.411051] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 764b0b91-9c29-4261-b801-b1e924956192 already deleted. [ 918.411183] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-764b0b91-9c29-4261-b801-b1e924956192" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.858533] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.858533] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.858533] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.858772] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.858847] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.858989] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Segment Port 4d6ed0f0-d40a-43e5-8dde-071620e70b3c not found, creating... [ 918.859339] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.859488] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.859583] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.859876] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.859961] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.860264] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.860503] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.860625] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.860829] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.860995] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.861131] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Resource: SegmentPort with ID: 4d6ed0f0-d40a-43e5-8dde-071620e70b3c is going to be created. [ 918.892224] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.892224] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.892224] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.892224] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.892224] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.892557] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "port-4d6ed0f0-d40a-43e5-8dde-071620e70b3c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.619630] env[65065]: INFO networking_nsxv3.common.synchronization [req-50a770f9-41ad-40dc-a6bc-1b1c2231019a req-ccfe0904-6c22-42ba-9d96-97fa22f4c1ca tempest-FloatingIPsAssociationNegativeTestJSON-103735492 tempest-FloatingIPsAssociationNegativeTestJSON-103735492-project-member] Enqueued Resource ID: 386d96b4-ccad-4c04-8bda-534b3f25dc91 with Priority: HIGHEST for action security_group_members [ 919.620164] env[65065]: INFO networking_nsxv3.common.synchronization [req-544aa606-553c-4c5e-9cbc-2c368899fbd5 req-15045494-47c1-40c8-b01c-d949d618b92b service nova] Enqueued Resource ID: 764b0b91-9c29-4261-b801-b1e924956192 with Priority: HIGHEST for action security_group_rules [ 919.620335] env[65065]: INFO networking_nsxv3.common.synchronization [req-544aa606-553c-4c5e-9cbc-2c368899fbd5 req-15045494-47c1-40c8-b01c-d949d618b92b service nova] Enqueued Resource ID: 764b0b91-9c29-4261-b801-b1e924956192 with Priority: HIGHEST for action security_group_members [ 919.620475] env[65065]: INFO networking_nsxv3.common.synchronization [req-544aa606-553c-4c5e-9cbc-2c368899fbd5 req-15045494-47c1-40c8-b01c-d949d618b92b service nova] Enqueued Resource ID: 4d6ed0f0-d40a-43e5-8dde-071620e70b3c with Priority: HIGHEST for action port [ 919.621225] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 386d96b4-ccad-4c04-8bda-534b3f25dc91 with Priority: HIGHEST for action security_group_members [ 919.621324] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 764b0b91-9c29-4261-b801-b1e924956192 with Priority: HIGHEST for action security_group_members [ 919.621429] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 764b0b91-9c29-4261-b801-b1e924956192 with Priority: HIGHEST for action security_group_rules [ 919.621645] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d6ed0f0-d40a-43e5-8dde-071620e70b3c with Priority: HIGHEST for action port [ 919.621971] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-386d96b4-ccad-4c04-8bda-534b3f25dc91 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.622073] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-386d96b4-ccad-4c04-8bda-534b3f25dc91" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.622175] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-386d96b4-ccad-4c04-8bda-534b3f25dc91" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.622406] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-386d96b4-ccad-4c04-8bda-534b3f25dc91" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.622568] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.622669] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.622739] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.622886] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.622981] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.623077] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('386d96b4-ccad-4c04-8bda-534b3f25dc91',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.623971] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-764b0b91-9c29-4261-b801-b1e924956192 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.624128] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-764b0b91-9c29-4261-b801-b1e924956192" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.624190] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-764b0b91-9c29-4261-b801-b1e924956192" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.624355] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-764b0b91-9c29-4261-b801-b1e924956192" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.624449] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.624540] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.624604] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.624743] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.624945] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.624945] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('764b0b91-9c29-4261-b801-b1e924956192',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.625757] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-764b0b91-9c29-4261-b801-b1e924956192 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.625862] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-764b0b91-9c29-4261-b801-b1e924956192" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.625939] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-764b0b91-9c29-4261-b801-b1e924956192" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.626157] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-764b0b91-9c29-4261-b801-b1e924956192" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.626985] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('764b0b91-9c29-4261-b801-b1e924956192',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.626985] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-4d6ed0f0-d40a-43e5-8dde-071620e70b3c taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.627133] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4d6ed0f0-d40a-43e5-8dde-071620e70b3c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.627133] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4d6ed0f0-d40a-43e5-8dde-071620e70b3c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.627299] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4d6ed0f0-d40a-43e5-8dde-071620e70b3c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.627341] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4d6ed0f0-d40a-43e5-8dde-071620e70b3c',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.134280] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('764b0b91-9c29-4261-b801-b1e924956192',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.134280] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.134280] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.134280] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.134280] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.134280] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.134280] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.134280] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.134280] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.134909] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.134985] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.135169] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 386d96b4-ccad-4c04-8bda-534b3f25dc91 is going to be updated. [ 920.136598] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-764b0b91-9c29-4261-b801-b1e924956192 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.136777] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-764b0b91-9c29-4261-b801-b1e924956192" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.138668] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4d6ed0f0-d40a-43e5-8dde-071620e70b3c with status ACTIVE [ 920.138668] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.138668] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.138668] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.138668] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.138668] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.138668] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.138668] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.138668] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.138668] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.138668] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.139438] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.139571] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.140261] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.140261] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.140261] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.140261] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4d6ed0f0-d40a-43e5-8dde-071620e70b3c is going to be updated. [ 920.171048] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.171251] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.171251] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.171496] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.171724] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.171907] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4d6ed0f0-d40a-43e5-8dde-071620e70b3c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.181340] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.181575] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.181575] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.181713] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.181829] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.184128] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e6d7baac-4bff-46b9-b88d-2dc982621c0f in Status: SUCCESS [ 920.184345] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.199961] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 386d96b4-ccad-4c04-8bda-534b3f25dc91 in Status: IN_PROGRESS for 2s [ 920.422202] env[65065]: INFO networking_nsxv3.common.synchronization [req-82a3e1c5-8a58-42f4-ac91-13d0a00b24df req-6e3489a6-4ef1-464f-9f41-e8f75f172f32 tempest-MultipleCreateTestJSON-605630201 tempest-MultipleCreateTestJSON-605630201-project-member] Enqueued Resource ID: d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f with Priority: HIGHEST for action security_group_members [ 920.422202] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f with Priority: HIGHEST for action security_group_members [ 920.422202] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.422202] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.422202] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.422202] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.422840] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.423134] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.423284] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.423550] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.424143] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.424352] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.644072] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('764b0b91-9c29-4261-b801-b1e924956192',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.824593] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock network-533 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.825435] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "network-533" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.825435] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "network-533" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.825435] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "network-533" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.825806] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.825806] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.825806] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.829058] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.829288] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.829640] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 920.829707] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 920.830068] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 920.830068] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 920.830068] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 920.830158] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 920.830474] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 920.850113] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 920.850113] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 920.850113] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 920.850291] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "network-533" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.851117] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock port-0fe647ad-c839-42df-a266-bf559559f76b taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.851117] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "port-0fe647ad-c839-42df-a266-bf559559f76b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.851117] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "port-0fe647ad-c839-42df-a266-bf559559f76b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.851324] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "port-0fe647ad-c839-42df-a266-bf559559f76b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.851324] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0fe647ad-c839-42df-a266-bf559559f76b',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.928062] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.928062] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.928062] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.928233] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.928291] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.928468] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.929200] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.929200] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.929200] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.929200] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.929200] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f already deleted. [ 920.929200] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.147506] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.147506] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.147506] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.147506] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.147506] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.147506] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 764b0b91-9c29-4261-b801-b1e924956192 is going to be created. [ 921.178692] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.178879] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.178949] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.179179] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.179371] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.193191] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 764b0b91-9c29-4261-b801-b1e924956192 in Status: UNINITIALIZED for 2s [ 921.353638] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.353869] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.353995] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.354392] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.354540] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.354723] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Segment Port 0fe647ad-c839-42df-a266-bf559559f76b not found, creating... [ 921.355040] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.355218] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.355336] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.355576] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.355717] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.356009] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.356398] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.356523] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.356740] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.356919] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.357141] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Resource: SegmentPort with ID: 0fe647ad-c839-42df-a266-bf559559f76b is going to be created. [ 921.382892] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.383136] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.383260] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.383561] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.383763] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.383990] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "port-0fe647ad-c839-42df-a266-bf559559f76b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.068116] env[65065]: INFO networking_nsxv3.common.synchronization [req-d70ed091-81e7-48bd-85cc-0f037c03321c req-6e6481cf-b399-4088-9315-9e224dec52bc tempest-ImagesOneServerNegativeTestJSON-764093247 tempest-ImagesOneServerNegativeTestJSON-764093247-project-member] Enqueued Resource ID: 9ed22036-e9a4-4639-89b9-c743ca686b09 with Priority: HIGHEST for action security_group_members [ 922.068909] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ed22036-e9a4-4639-89b9-c743ca686b09 with Priority: HIGHEST for action security_group_members [ 922.069394] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ed22036-e9a4-4639-89b9-c743ca686b09 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.069574] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ed22036-e9a4-4639-89b9-c743ca686b09" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.069681] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ed22036-e9a4-4639-89b9-c743ca686b09" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.069998] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ed22036-e9a4-4639-89b9-c743ca686b09" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.070219] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.070373] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.070670] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.070736] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.070839] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.070978] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ed22036-e9a4-4639-89b9-c743ca686b09',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.145021] env[65065]: INFO networking_nsxv3.common.synchronization [req-82a3e1c5-8a58-42f4-ac91-13d0a00b24df req-98f14e72-ae83-4959-811d-226a0d4b8afa service nova] Enqueued Resource ID: d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f with Priority: HIGHEST for action security_group_rules [ 922.146043] env[65065]: INFO networking_nsxv3.common.synchronization [req-82a3e1c5-8a58-42f4-ac91-13d0a00b24df req-98f14e72-ae83-4959-811d-226a0d4b8afa service nova] Enqueued Resource ID: d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f with Priority: HIGHEST for action security_group_members [ 922.146499] env[65065]: INFO networking_nsxv3.common.synchronization [req-82a3e1c5-8a58-42f4-ac91-13d0a00b24df req-98f14e72-ae83-4959-811d-226a0d4b8afa service nova] Enqueued Resource ID: 0fe647ad-c839-42df-a266-bf559559f76b with Priority: HIGHEST for action port [ 922.148895] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f with Priority: HIGHEST for action security_group_rules [ 922.148895] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f with Priority: HIGHEST for action security_group_members [ 922.148895] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0fe647ad-c839-42df-a266-bf559559f76b with Priority: HIGHEST for action port [ 922.148895] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.148895] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.148895] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.150855] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.151590] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.152976] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.155097] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.155097] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.155097] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.155097] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.155097] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.156040] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.156040] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.156040] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.156040] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.157599] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-0fe647ad-c839-42df-a266-bf559559f76b taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.157792] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0fe647ad-c839-42df-a266-bf559559f76b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.157897] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0fe647ad-c839-42df-a266-bf559559f76b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.158306] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0fe647ad-c839-42df-a266-bf559559f76b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.158306] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0fe647ad-c839-42df-a266-bf559559f76b',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.211164] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 386d96b4-ccad-4c04-8bda-534b3f25dc91 in Status: SUCCESS [ 922.211449] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 386d96b4-ccad-4c04-8bda-534b3f25dc91 deletion is rescheduled due to dependency. [ 922.211645] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-386d96b4-ccad-4c04-8bda-534b3f25dc91" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.574193] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.574193] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.574411] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.574467] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.574569] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.574779] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.574937] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.574937] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.575127] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.575167] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.575266] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ed22036-e9a4-4639-89b9-c743ca686b09 is going to be updated. [ 922.617797] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.617952] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.618321] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.618411] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.618472] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.629190] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ed22036-e9a4-4639-89b9-c743ca686b09 in Status: IN_PROGRESS for 2s [ 922.658903] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.662961] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.663354] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.663354] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0fe647ad-c839-42df-a266-bf559559f76b with status ACTIVE [ 922.664231] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.664231] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.664231] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.664231] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.664231] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.664231] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.664231] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.664231] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.664621] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.664621] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.664621] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.664749] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.664749] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.664967] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.664967] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.665070] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0fe647ad-c839-42df-a266-bf559559f76b is going to be updated. [ 922.704302] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.704495] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.704545] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.704837] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.705662] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.705662] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0fe647ad-c839-42df-a266-bf559559f76b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.958266] env[65065]: INFO networking_nsxv3.common.synchronization [req-82a3e1c5-8a58-42f4-ac91-13d0a00b24df req-af390518-764b-4edc-a805-c6c23a399103 tempest-MultipleCreateTestJSON-605630201 tempest-MultipleCreateTestJSON-605630201-project-member] Enqueued Resource ID: d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f with Priority: HIGHEST for action security_group_members [ 922.958991] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f with Priority: HIGHEST for action security_group_members [ 922.959359] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.962932] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.163724] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.205467] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 764b0b91-9c29-4261-b801-b1e924956192 in Status: SUCCESS [ 923.207573] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-764b0b91-9c29-4261-b801-b1e924956192" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.207573] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-764b0b91-9c29-4261-b801-b1e924956192" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.208283] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-764b0b91-9c29-4261-b801-b1e924956192" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.208512] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.208639] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.208706] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.208913] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.209017] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.209124] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-764b0b91-9c29-4261-b801-b1e924956192" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.209426] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('764b0b91-9c29-4261-b801-b1e924956192',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.356589] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock network-533 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.356589] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "network-533" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.356589] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "network-533" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.360023] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "network-533" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.360023] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.360023] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.360023] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.360023] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.360023] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.360023] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 923.360023] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 923.360023] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 923.360023] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 923.360023] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 923.360023] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 923.360786] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 923.385563] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 923.385563] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 923.385563] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 923.385675] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "network-533" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.386772] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock port-88f61d87-63ce-4a18-8cc4-457179bc94ac taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.386772] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "port-88f61d87-63ce-4a18-8cc4-457179bc94ac" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.386772] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "port-88f61d87-63ce-4a18-8cc4-457179bc94ac" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.386772] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "port-88f61d87-63ce-4a18-8cc4-457179bc94ac" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.387036] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('88f61d87-63ce-4a18-8cc4-457179bc94ac',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.666982] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.667238] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.667408] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.667618] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.667734] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.667840] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f is going to be created. [ 923.693135] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.693353] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.693353] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.693556] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.693714] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.703720] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f in Status: UNINITIALIZED for 2s [ 923.711318] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-764b0b91-9c29-4261-b801-b1e924956192 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.711464] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-764b0b91-9c29-4261-b801-b1e924956192" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.711534] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-764b0b91-9c29-4261-b801-b1e924956192" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.711754] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-764b0b91-9c29-4261-b801-b1e924956192" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.711916] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.712028] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.712096] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.712271] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.712332] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.712438] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-764b0b91-9c29-4261-b801-b1e924956192" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.712553] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-764b0b91-9c29-4261-b801-b1e924956192 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.712645] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-764b0b91-9c29-4261-b801-b1e924956192" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.712738] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-764b0b91-9c29-4261-b801-b1e924956192" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.712839] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-764b0b91-9c29-4261-b801-b1e924956192" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.712972] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.713074] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.713138] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.713260] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.713347] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.713408] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-764b0b91-9c29-4261-b801-b1e924956192" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.713502] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('764b0b91-9c29-4261-b801-b1e924956192',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.889888] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.890142] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.890271] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.890613] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.890780] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.890938] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Segment Port 88f61d87-63ce-4a18-8cc4-457179bc94ac not found, creating... [ 923.891214] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.891374] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.891490] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.891726] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.891854] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.892150] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.892304] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.892420] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.892625] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.892756] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.892916] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Resource: SegmentPort with ID: 88f61d87-63ce-4a18-8cc4-457179bc94ac is going to be created. [ 923.917251] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.917622] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.917814] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.918218] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.918729] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.918977] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "port-88f61d87-63ce-4a18-8cc4-457179bc94ac" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.215727] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 764b0b91-9c29-4261-b801-b1e924956192: rpc.has_security_group_logging(os_id): False [ 924.240924] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.242569] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.242569] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.242569] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.242569] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.242569] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.242569] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.242569] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.242569] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.242569] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.242569] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.242569] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.242569] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.242569] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.242569] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.244258] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.244258] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.244258] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.244258] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.244258] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.244258] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 764b0b91-9c29-4261-b801-b1e924956192 is going to be created. [ 924.312962] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.312962] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.312962] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.312962] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.312962] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.323701] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 764b0b91-9c29-4261-b801-b1e924956192 in Status: IN_PROGRESS for 2s [ 924.642579] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ed22036-e9a4-4639-89b9-c743ca686b09 in Status: SUCCESS [ 924.642579] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ed22036-e9a4-4639-89b9-c743ca686b09 deletion is rescheduled due to dependency. [ 924.642579] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ed22036-e9a4-4639-89b9-c743ca686b09" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.724303] env[65065]: INFO networking_nsxv3.common.synchronization [req-82a3e1c5-8a58-42f4-ac91-13d0a00b24df req-91eaf531-f811-4608-ab36-30b2d297629d service nova] Enqueued Resource ID: d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f with Priority: HIGHEST for action security_group_rules [ 924.724502] env[65065]: INFO networking_nsxv3.common.synchronization [req-82a3e1c5-8a58-42f4-ac91-13d0a00b24df req-91eaf531-f811-4608-ab36-30b2d297629d service nova] Enqueued Resource ID: d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f with Priority: HIGHEST for action security_group_members [ 924.725116] env[65065]: INFO networking_nsxv3.common.synchronization [req-82a3e1c5-8a58-42f4-ac91-13d0a00b24df req-91eaf531-f811-4608-ab36-30b2d297629d service nova] Enqueued Resource ID: 88f61d87-63ce-4a18-8cc4-457179bc94ac with Priority: HIGHEST for action port [ 924.725442] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f with Priority: HIGHEST for action security_group_rules [ 924.725614] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f with Priority: HIGHEST for action security_group_members [ 924.725809] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88f61d87-63ce-4a18-8cc4-457179bc94ac with Priority: HIGHEST for action port [ 924.726373] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.726444] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.727678] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.727782] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.728190] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-88f61d87-63ce-4a18-8cc4-457179bc94ac taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.728190] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-88f61d87-63ce-4a18-8cc4-457179bc94ac" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.728458] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-88f61d87-63ce-4a18-8cc4-457179bc94ac" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.728576] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-88f61d87-63ce-4a18-8cc4-457179bc94ac" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.728710] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('88f61d87-63ce-4a18-8cc4-457179bc94ac',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.234627] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 88f61d87-63ce-4a18-8cc4-457179bc94ac with status ACTIVE [ 925.234627] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.234627] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.234627] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.234627] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.234627] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.234627] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.234627] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.234627] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.234627] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.234627] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.234627] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.234627] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.234627] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.234627] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.234627] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.234627] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 88f61d87-63ce-4a18-8cc4-457179bc94ac is going to be updated. [ 925.258599] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.258792] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.258792] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.259019] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.259168] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.259353] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-88f61d87-63ce-4a18-8cc4-457179bc94ac" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.523424] env[65065]: INFO networking_nsxv3.common.synchronization [req-add4c710-21f5-4a83-8ecc-0972d7548924 req-160ded36-5545-4f52-bea1-23ae4f0b1a93 tempest-DeleteServersTestJSON-1316666736 tempest-DeleteServersTestJSON-1316666736-project-member] Enqueued Resource ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 with Priority: HIGHEST for action security_group_members [ 925.523905] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 with Priority: HIGHEST for action security_group_members [ 925.524391] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d0941d4-57d8-45e9-9f2f-95128b8136e5 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.524391] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.524979] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.525347] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.525410] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.525475] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.525522] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.525679] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.525745] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.525850] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d0941d4-57d8-45e9-9f2f-95128b8136e5',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.714383] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f in Status: SUCCESS [ 925.714669] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.714872] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.715106] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.715297] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.715417] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.715485] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.715633] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.715710] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.715793] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.715890] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.716716] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.716874] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.717609] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.717775] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.717850] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.718767] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.718767] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.718767] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.974305] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock network-950 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.974521] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "network-950" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.974649] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "network-950" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.974955] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "network-950" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.975239] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.975538] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.975538] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.975724] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.975872] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.976384] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 925.976384] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 925.976384] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 925.976568] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 925.976568] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 925.977061] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 925.977061] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 926.004523] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 926.004816] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 926.005100] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 926.005178] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "network-950" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.005656] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock port-ecd3dc54-0388-455b-b9aa-bf9fbfb22757 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.005935] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "port-ecd3dc54-0388-455b-b9aa-bf9fbfb22757" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.012127] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "port-ecd3dc54-0388-455b-b9aa-bf9fbfb22757" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.012315] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "port-ecd3dc54-0388-455b-b9aa-bf9fbfb22757" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.012455] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ecd3dc54-0388-455b-b9aa-bf9fbfb22757',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.029662] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.029830] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.029898] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.030145] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.031430] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.031430] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.031430] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.031430] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.031430] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.031430] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.031430] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 is going to be updated. [ 926.062152] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.062386] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.062490] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.062653] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.062814] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.072673] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 in Status: IN_PROGRESS for 2s [ 926.153810] env[65065]: INFO networking_nsxv3.common.synchronization [None req-83f35481-396d-44d4-9c89-eb655cef6384 None None] Enqueued Resource ID: 9d9bf392-2540-40f8-8e50-36ca60196886 with Priority: HIGHEST for action port [ 926.154346] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d9bf392-2540-40f8-8e50-36ca60196886 with Priority: HIGHEST for action port [ 926.157587] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-9d9bf392-2540-40f8-8e50-36ca60196886 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.157779] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9d9bf392-2540-40f8-8e50-36ca60196886" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.157845] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9d9bf392-2540-40f8-8e50-36ca60196886" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.158091] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9d9bf392-2540-40f8-8e50-36ca60196886" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.160023] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9d9bf392-2540-40f8-8e50-36ca60196886',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.221071] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.221071] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.221071] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.351409] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 764b0b91-9c29-4261-b801-b1e924956192 in Status: SUCCESS [ 926.351973] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-764b0b91-9c29-4261-b801-b1e924956192" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.516371] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.516641] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.516898] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.517111] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.518145] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.519129] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Segment Port ecd3dc54-0388-455b-b9aa-bf9fbfb22757 not found, creating... [ 926.519743] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.519986] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.520279] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.521248] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.521465] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.522451] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.522675] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.522829] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.523095] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.523302] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.523537] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Resource: SegmentPort with ID: ecd3dc54-0388-455b-b9aa-bf9fbfb22757 is going to be created. [ 926.548334] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.548641] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.548837] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.549220] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.549578] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.549918] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "port-ecd3dc54-0388-455b-b9aa-bf9fbfb22757" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.660453] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9d9bf392-2540-40f8-8e50-36ca60196886 [ 926.660818] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.661057] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.661120] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.661518] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.661724] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.662642] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9d9bf392-2540-40f8-8e50-36ca60196886 already deleted. [ 926.662642] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9d9bf392-2540-40f8-8e50-36ca60196886" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.725426] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.230115] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.230318] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.230389] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.230651] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.231076] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.231076] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f is going to be updated. [ 927.265013] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.265344] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.265431] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.265645] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.265961] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.277771] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f in Status: IN_PROGRESS for 2s [ 927.364585] env[65065]: INFO networking_nsxv3.common.synchronization [req-add4c710-21f5-4a83-8ecc-0972d7548924 req-77359576-f9f3-4653-90d1-9f262f00163a service nova] Enqueued Resource ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 with Priority: HIGHEST for action security_group_rules [ 927.364585] env[65065]: INFO networking_nsxv3.common.synchronization [req-add4c710-21f5-4a83-8ecc-0972d7548924 req-77359576-f9f3-4653-90d1-9f262f00163a service nova] Enqueued Resource ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 with Priority: HIGHEST for action security_group_members [ 927.364585] env[65065]: INFO networking_nsxv3.common.synchronization [req-add4c710-21f5-4a83-8ecc-0972d7548924 req-77359576-f9f3-4653-90d1-9f262f00163a service nova] Enqueued Resource ID: ecd3dc54-0388-455b-b9aa-bf9fbfb22757 with Priority: HIGHEST for action port [ 927.364585] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 with Priority: HIGHEST for action security_group_rules [ 927.364585] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 with Priority: HIGHEST for action security_group_members [ 927.364585] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ecd3dc54-0388-455b-b9aa-bf9fbfb22757 with Priority: HIGHEST for action port [ 927.364585] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7d0941d4-57d8-45e9-9f2f-95128b8136e5 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.366823] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.366823] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.366823] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.366823] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7d0941d4-57d8-45e9-9f2f-95128b8136e5',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.367381] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d0941d4-57d8-45e9-9f2f-95128b8136e5 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.367589] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.368288] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-ecd3dc54-0388-455b-b9aa-bf9fbfb22757 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.368746] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ecd3dc54-0388-455b-b9aa-bf9fbfb22757" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.372581] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ecd3dc54-0388-455b-b9aa-bf9fbfb22757" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.372581] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ecd3dc54-0388-455b-b9aa-bf9fbfb22757" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.372581] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ecd3dc54-0388-455b-b9aa-bf9fbfb22757',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.875791] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d0941d4-57d8-45e9-9f2f-95128b8136e5 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.875791] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.875791] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ecd3dc54-0388-455b-b9aa-bf9fbfb22757 with status ACTIVE [ 927.875791] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.875791] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.875791] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.875791] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.875791] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.876136] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.876136] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.876136] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.876312] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.876412] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.876710] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.876807] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.876866] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.877131] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.878181] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.878346] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ecd3dc54-0388-455b-b9aa-bf9fbfb22757 is going to be updated. [ 927.917858] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.918208] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.918208] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.918877] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.918877] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.918877] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ecd3dc54-0388-455b-b9aa-bf9fbfb22757" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.090956] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 in Status: SUCCESS [ 928.091341] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 deletion is rescheduled due to dependency. [ 928.091341] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.091468] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.092338] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.092338] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.092338] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.092338] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.092338] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.092338] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.092338] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d0941d4-57d8-45e9-9f2f-95128b8136e5',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.192210] env[65065]: INFO networking_nsxv3.common.synchronization [req-6a2c7de0-ce2c-4a5c-840e-ae5f6ee0d0f6 req-e625132b-d8cc-45be-98bc-83bf5a125ba8 tempest-ServerDiskConfigTestJSON-975440465 tempest-ServerDiskConfigTestJSON-975440465-project-member] Enqueued Resource ID: ffd44fac-c762-408c-862b-ccea34e00947 with Priority: HIGHEST for action security_group_members [ 928.192210] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ffd44fac-c762-408c-862b-ccea34e00947 with Priority: HIGHEST for action security_group_members [ 928.195309] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-ffd44fac-c762-408c-862b-ccea34e00947 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.195883] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.196425] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.196780] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.197868] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.197868] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.197868] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.197868] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.197868] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.198283] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ffd44fac-c762-408c-862b-ccea34e00947',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.594535] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7d0941d4-57d8-45e9-9f2f-95128b8136e5',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.646755] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock network-34 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.646755] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "network-34" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.646755] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "network-34" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.646755] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "network-34" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.647043] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.647043] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.647286] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.647500] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.647650] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.647903] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 928.648030] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 928.648145] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 928.648321] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 928.648457] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 928.648572] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 928.648800] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 928.672111] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 928.672305] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 928.672442] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 928.672624] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "network-34" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.673017] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock port-f3489606-b5f0-466a-aec4-03c484ad6a74 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.673161] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "port-f3489606-b5f0-466a-aec4-03c484ad6a74" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.673357] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "port-f3489606-b5f0-466a-aec4-03c484ad6a74" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.673627] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "port-f3489606-b5f0-466a-aec4-03c484ad6a74" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.673765] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f3489606-b5f0-466a-aec4-03c484ad6a74',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.701556] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.701556] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.701863] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.702236] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.702393] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.702710] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.702878] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.703011] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.703468] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.703468] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.703642] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ffd44fac-c762-408c-862b-ccea34e00947 is going to be updated. [ 928.741024] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.741326] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.741326] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.741529] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.741693] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.754724] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ffd44fac-c762-408c-862b-ccea34e00947 in Status: IN_PROGRESS for 2s [ 928.958398] env[65065]: INFO networking_nsxv3.common.synchronization [None req-bd74386f-3e12-4444-ac10-0d5cb5475c90 None None] Enqueued Resource ID: a4c880a7-5133-4270-a7ff-7fcf7580618b with Priority: HIGHEST for action port [ 928.958398] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4c880a7-5133-4270-a7ff-7fcf7580618b with Priority: HIGHEST for action port [ 928.958398] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-a4c880a7-5133-4270-a7ff-7fcf7580618b taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.958398] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a4c880a7-5133-4270-a7ff-7fcf7580618b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.958398] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a4c880a7-5133-4270-a7ff-7fcf7580618b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.958694] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a4c880a7-5133-4270-a7ff-7fcf7580618b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.958949] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a4c880a7-5133-4270-a7ff-7fcf7580618b',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.097965] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7d0941d4-57d8-45e9-9f2f-95128b8136e5',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.180025] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.180025] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.180025] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.180025] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.180025] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.180025] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Segment Port f3489606-b5f0-466a-aec4-03c484ad6a74 not found, creating... [ 929.180025] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.180025] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.180025] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.180025] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.180025] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.180766] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.180766] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.180766] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.180766] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.180766] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.180766] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Resource: SegmentPort with ID: f3489606-b5f0-466a-aec4-03c484ad6a74 is going to be created. [ 929.204463] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.204463] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.204463] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.204463] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.204463] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.204463] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "port-f3489606-b5f0-466a-aec4-03c484ad6a74" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.289064] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f in Status: SUCCESS [ 929.289534] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.289895] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.290317] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.290736] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.291041] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.291310] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.291618] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.291804] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.292075] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.462096] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a4c880a7-5133-4270-a7ff-7fcf7580618b [ 929.462423] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.462578] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.463075] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.463075] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.463075] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.463075] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a4c880a7-5133-4270-a7ff-7fcf7580618b already deleted. [ 929.463075] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a4c880a7-5133-4270-a7ff-7fcf7580618b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.603074] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.603074] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.603074] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.603074] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.603074] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.603074] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 is going to be updated. [ 929.652141] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.652584] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.652746] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.653048] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.653287] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.665240] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 in Status: IN_PROGRESS for 2s [ 929.794952] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.046913] env[65065]: INFO networking_nsxv3.common.synchronization [req-6a2c7de0-ce2c-4a5c-840e-ae5f6ee0d0f6 req-c014de0e-b945-4158-912f-7e056923e8f0 service nova] Enqueued Resource ID: ffd44fac-c762-408c-862b-ccea34e00947 with Priority: HIGHEST for action security_group_rules [ 930.047665] env[65065]: INFO networking_nsxv3.common.synchronization [req-6a2c7de0-ce2c-4a5c-840e-ae5f6ee0d0f6 req-c014de0e-b945-4158-912f-7e056923e8f0 service nova] Enqueued Resource ID: ffd44fac-c762-408c-862b-ccea34e00947 with Priority: HIGHEST for action security_group_members [ 930.047920] env[65065]: INFO networking_nsxv3.common.synchronization [req-6a2c7de0-ce2c-4a5c-840e-ae5f6ee0d0f6 req-c014de0e-b945-4158-912f-7e056923e8f0 service nova] Enqueued Resource ID: f3489606-b5f0-466a-aec4-03c484ad6a74 with Priority: HIGHEST for action port [ 930.048718] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ffd44fac-c762-408c-862b-ccea34e00947 with Priority: HIGHEST for action security_group_rules [ 930.048911] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ffd44fac-c762-408c-862b-ccea34e00947 with Priority: HIGHEST for action security_group_members [ 930.049028] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3489606-b5f0-466a-aec4-03c484ad6a74 with Priority: HIGHEST for action port [ 930.049419] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ffd44fac-c762-408c-862b-ccea34e00947 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.049552] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.049661] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.050032] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.050157] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ffd44fac-c762-408c-862b-ccea34e00947',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.051632] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-ffd44fac-c762-408c-862b-ccea34e00947 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.055023] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.055023] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-f3489606-b5f0-466a-aec4-03c484ad6a74 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.055023] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f3489606-b5f0-466a-aec4-03c484ad6a74" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.055023] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f3489606-b5f0-466a-aec4-03c484ad6a74" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.055023] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f3489606-b5f0-466a-aec4-03c484ad6a74" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.055023] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f3489606-b5f0-466a-aec4-03c484ad6a74',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.298018] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.558614] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-ffd44fac-c762-408c-862b-ccea34e00947 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.558614] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.558614] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f3489606-b5f0-466a-aec4-03c484ad6a74 with status ACTIVE [ 930.558614] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.558932] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.558932] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.559657] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.559657] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.559657] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.559657] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.559657] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.561078] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.561078] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.561078] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.561078] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.561078] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.561078] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.561078] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.561078] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f3489606-b5f0-466a-aec4-03c484ad6a74 is going to be updated. [ 930.592161] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.592531] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.592531] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.592819] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.592941] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.593375] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f3489606-b5f0-466a-aec4-03c484ad6a74" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.774057] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ffd44fac-c762-408c-862b-ccea34e00947 in Status: SUCCESS [ 930.774423] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ffd44fac-c762-408c-862b-ccea34e00947 deletion is rescheduled due to dependency. [ 930.774423] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.774812] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.774812] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.775073] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.775073] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.775198] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.775432] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.775432] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.775432] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ffd44fac-c762-408c-862b-ccea34e00947',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.800330] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.800527] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.800627] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.800839] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.800956] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.801087] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f is going to be updated. [ 930.840349] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.840782] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.840782] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.840982] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.841146] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.852851] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f in Status: IN_PROGRESS for 2s [ 931.277841] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ffd44fac-c762-408c-862b-ccea34e00947',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.679303] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 in Status: SUCCESS [ 931.679303] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.679303] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.679583] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.679643] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.679793] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.679866] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.680015] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.680939] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.680939] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.680939] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7d0941d4-57d8-45e9-9f2f-95128b8136e5',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.781107] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ffd44fac-c762-408c-862b-ccea34e00947',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.183684] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d0941d4-57d8-45e9-9f2f-95128b8136e5 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.183925] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.183968] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.184345] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.184558] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.184716] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.184815] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.185017] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.185123] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.185219] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.185403] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d0941d4-57d8-45e9-9f2f-95128b8136e5 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.185545] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.185618] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.185774] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.185943] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.186053] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.186114] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.186283] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.186364] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.186465] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.186560] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7d0941d4-57d8-45e9-9f2f-95128b8136e5',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.283969] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.284258] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.284406] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.284845] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.285075] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.285243] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ffd44fac-c762-408c-862b-ccea34e00947 is going to be updated. [ 932.324916] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.325120] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.325168] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.325362] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.325512] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.339577] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ffd44fac-c762-408c-862b-ccea34e00947 in Status: IN_PROGRESS for 2s [ 932.689946] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7d0941d4-57d8-45e9-9f2f-95128b8136e5: rpc.has_security_group_logging(os_id): False [ 932.723596] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.723596] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.723596] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.723596] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.723960] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.723960] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.724068] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.724068] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.724200] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.724359] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.724561] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.724665] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.724764] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.724952] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.725041] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.725254] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.725362] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.725429] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.725582] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.725737] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.725790] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 is going to be updated. [ 932.806576] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.807054] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.807054] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.807054] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.807214] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.824603] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 in Status: IN_PROGRESS for 2s [ 932.868918] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f in Status: SUCCESS [ 932.869297] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.869589] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.869841] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.870232] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.870348] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.870348] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.870606] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.870741] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.870810] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.871034] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.871181] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.871240] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.871402] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.871645] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.871822] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.871822] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.872047] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.872139] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.872252] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.872369] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.111520] env[65065]: INFO networking_nsxv3.common.synchronization [req-4ef72a8f-9b6b-4b49-814b-f8ed8b98a2bb req-539f9cff-6636-4e06-ae62-b463a2337025 tempest-ImagesTestJSON-1714479415 tempest-ImagesTestJSON-1714479415-project-member] Enqueued Resource ID: e6d7baac-4bff-46b9-b88d-2dc982621c0f with Priority: HIGHEST for action security_group_members [ 933.111797] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6d7baac-4bff-46b9-b88d-2dc982621c0f with Priority: HIGHEST for action security_group_members [ 933.112483] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6d7baac-4bff-46b9-b88d-2dc982621c0f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.112612] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.112683] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.112892] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.113066] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.113165] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.113226] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.113375] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.113460] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.113573] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e6d7baac-4bff-46b9-b88d-2dc982621c0f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.374662] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f: rpc.has_security_group_logging(os_id): False [ 933.395122] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.395387] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.395387] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.395573] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.395663] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.395858] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.395958] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.396039] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.396217] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.396315] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.396491] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.396617] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.396677] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.396826] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.396892] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.397127] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.397217] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.397304] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.397503] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.397619] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.397712] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f is going to be created. [ 933.499155] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.499437] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.499529] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.499852] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.500123] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.526501] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f in Status: IN_PROGRESS for 2s [ 933.593720] env[65065]: INFO networking_nsxv3.common.synchronization [req-b50fac3b-0e55-4834-a065-d7c3b30fe6d1 req-c8f65b95-5b7d-422c-a476-256e866ec4fa tempest-ServerMetadataNegativeTestJSON-504279798 tempest-ServerMetadataNegativeTestJSON-504279798-project-member] Enqueued Resource ID: 764b0b91-9c29-4261-b801-b1e924956192 with Priority: HIGHEST for action security_group_members [ 933.594429] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 764b0b91-9c29-4261-b801-b1e924956192 with Priority: HIGHEST for action security_group_members [ 933.594861] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-764b0b91-9c29-4261-b801-b1e924956192 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.595018] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-764b0b91-9c29-4261-b801-b1e924956192" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.595093] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-764b0b91-9c29-4261-b801-b1e924956192" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.595360] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-764b0b91-9c29-4261-b801-b1e924956192" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.595578] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.595696] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.595774] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.596026] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.596170] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.596298] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('764b0b91-9c29-4261-b801-b1e924956192',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.616590] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.617508] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.617508] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.617508] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.617508] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.617652] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.617803] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.618510] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.618510] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.618510] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.618679] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6d7baac-4bff-46b9-b88d-2dc982621c0f is going to be updated. [ 933.661404] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.661775] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.661775] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.661902] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.662077] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.677917] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6d7baac-4bff-46b9-b88d-2dc982621c0f in Status: IN_PROGRESS for 2s [ 934.099497] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.099897] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.099897] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.100036] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.100036] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.100274] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.100370] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.100445] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.100607] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.100762] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.100829] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 764b0b91-9c29-4261-b801-b1e924956192 is going to be updated. [ 934.136884] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.137980] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.138141] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.138437] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.138605] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.149073] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 764b0b91-9c29-4261-b801-b1e924956192 in Status: IN_PROGRESS for 2s [ 934.351136] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ffd44fac-c762-408c-862b-ccea34e00947 in Status: SUCCESS [ 934.351450] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.351500] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.351740] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.351966] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.352095] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.352185] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.352347] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.352425] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.352518] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.352614] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ffd44fac-c762-408c-862b-ccea34e00947',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.548353] env[65065]: INFO networking_nsxv3.common.synchronization [req-00e730a1-8d21-436b-ad4a-f38665ff93ab req-a4974a6d-f5e8-424f-9a49-36dcdc6e797d tempest-AttachInterfacesTestJSON-1590270829 tempest-AttachInterfacesTestJSON-1590270829-project-member] Enqueued Resource ID: cce60a92-c34e-445e-97a5-b8cfceb8b2b3 with Priority: HIGHEST for action security_group_members [ 934.548926] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cce60a92-c34e-445e-97a5-b8cfceb8b2b3 with Priority: HIGHEST for action security_group_members [ 934.549551] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-cce60a92-c34e-445e-97a5-b8cfceb8b2b3 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.549700] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cce60a92-c34e-445e-97a5-b8cfceb8b2b3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.549764] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cce60a92-c34e-445e-97a5-b8cfceb8b2b3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.550076] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cce60a92-c34e-445e-97a5-b8cfceb8b2b3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.550749] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.550749] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.550749] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.551105] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.551198] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.551309] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cce60a92-c34e-445e-97a5-b8cfceb8b2b3',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.731909] env[65065]: INFO networking_nsxv3.common.synchronization [req-5ba00a3f-0982-4f68-b0ec-3247faee5bb9 req-adb7fdd9-8394-4202-9809-816e7b1446b5 tempest-ListServerFiltersTestJSON-2126051990 tempest-ListServerFiltersTestJSON-2126051990-project-member] Enqueued Resource ID: b36fec68-8054-450e-a4b6-c700b29fd114 with Priority: HIGHEST for action security_group_members [ 934.733110] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b36fec68-8054-450e-a4b6-c700b29fd114 with Priority: HIGHEST for action security_group_members [ 934.733480] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-b36fec68-8054-450e-a4b6-c700b29fd114 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.733624] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b36fec68-8054-450e-a4b6-c700b29fd114" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.733685] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b36fec68-8054-450e-a4b6-c700b29fd114" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.733893] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b36fec68-8054-450e-a4b6-c700b29fd114" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.734053] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.734501] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.734564] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.734724] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.734817] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.734933] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b36fec68-8054-450e-a4b6-c700b29fd114',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.842639] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 in Status: SUCCESS [ 934.842927] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.855587] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-ffd44fac-c762-408c-862b-ccea34e00947 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.855765] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.855841] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.856096] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.856285] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.856363] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.856428] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.856591] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.856675] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.856784] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.856914] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-ffd44fac-c762-408c-862b-ccea34e00947 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.857016] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.857080] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.857221] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.857405] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.857516] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.857584] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.857738] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.857841] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.857934] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.858041] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ffd44fac-c762-408c-862b-ccea34e00947',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.954482] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock network-688 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.954854] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "network-688" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.954854] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "network-688" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.955121] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "network-688" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.955402] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.955587] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.955725] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.956056] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.956194] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.956456] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 934.956706] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 934.956706] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 934.956825] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 934.957587] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 934.957587] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 934.957587] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 934.979810] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 934.980014] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 934.980626] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 934.980626] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "network-688" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.981167] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock port-c24aad4d-bc4c-4934-b881-210e94ee9ce6 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.981488] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "port-c24aad4d-bc4c-4934-b881-210e94ee9ce6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.981656] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "port-c24aad4d-bc4c-4934-b881-210e94ee9ce6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.982172] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "port-c24aad4d-bc4c-4934-b881-210e94ee9ce6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.982312] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c24aad4d-bc4c-4934-b881-210e94ee9ce6',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.053032] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.053210] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.053281] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.053505] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.053597] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.053797] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.053896] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.053994] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.054137] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.054208] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.054263] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cce60a92-c34e-445e-97a5-b8cfceb8b2b3 already deleted. [ 935.054381] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cce60a92-c34e-445e-97a5-b8cfceb8b2b3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.239537] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b36fec68-8054-450e-a4b6-c700b29fd114',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.360198] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ffd44fac-c762-408c-862b-ccea34e00947: rpc.has_security_group_logging(os_id): False [ 935.380017] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.380176] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.380221] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.380438] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.380527] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.380716] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.380804] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.380866] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.381022] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.381090] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.381273] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.381366] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.381428] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.381567] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.381689] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.381847] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.381924] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.381979] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.382129] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.382203] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.382293] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ffd44fac-c762-408c-862b-ccea34e00947 is going to be updated. [ 935.444345] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.444345] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.444345] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.444345] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.444345] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.459168] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ffd44fac-c762-408c-862b-ccea34e00947 in Status: IN_PROGRESS for 2s [ 935.488892] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.488892] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.489105] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.490850] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.490850] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.490850] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Segment Port c24aad4d-bc4c-4934-b881-210e94ee9ce6 not found, creating... [ 935.490850] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.490850] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.490850] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.490850] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.490850] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.491275] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.491275] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.491365] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.491515] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.491994] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.491994] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Resource: SegmentPort with ID: c24aad4d-bc4c-4934-b881-210e94ee9ce6 is going to be created. [ 935.526835] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.526835] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.527070] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.527234] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.527605] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.527873] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "port-c24aad4d-bc4c-4934-b881-210e94ee9ce6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.555258] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f in Status: SUCCESS [ 935.555258] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.555258] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.555258] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.555258] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.689853] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6d7baac-4bff-46b9-b88d-2dc982621c0f in Status: SUCCESS [ 935.690634] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6d7baac-4bff-46b9-b88d-2dc982621c0f deletion is rescheduled due to dependency. [ 935.690634] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.742042] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b36fec68-8054-450e-a4b6-c700b29fd114',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.057487] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.057659] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.057711] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.057942] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.058131] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.058234] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.058297] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.058443] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.058530] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.058619] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.058761] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.159878] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 764b0b91-9c29-4261-b801-b1e924956192 in Status: SUCCESS [ 936.160121] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 764b0b91-9c29-4261-b801-b1e924956192 deletion is rescheduled due to dependency. [ 936.160189] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-764b0b91-9c29-4261-b801-b1e924956192" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.211245] env[65065]: INFO networking_nsxv3.common.synchronization [req-00e730a1-8d21-436b-ad4a-f38665ff93ab req-0ebf3ad9-6205-425e-8e3d-706136eaf976 service nova] Enqueued Resource ID: cce60a92-c34e-445e-97a5-b8cfceb8b2b3 with Priority: HIGHEST for action security_group_rules [ 936.211431] env[65065]: INFO networking_nsxv3.common.synchronization [req-00e730a1-8d21-436b-ad4a-f38665ff93ab req-0ebf3ad9-6205-425e-8e3d-706136eaf976 service nova] Enqueued Resource ID: cce60a92-c34e-445e-97a5-b8cfceb8b2b3 with Priority: HIGHEST for action security_group_members [ 936.211593] env[65065]: INFO networking_nsxv3.common.synchronization [req-00e730a1-8d21-436b-ad4a-f38665ff93ab req-0ebf3ad9-6205-425e-8e3d-706136eaf976 service nova] Enqueued Resource ID: c24aad4d-bc4c-4934-b881-210e94ee9ce6 with Priority: HIGHEST for action port [ 936.212140] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cce60a92-c34e-445e-97a5-b8cfceb8b2b3 with Priority: HIGHEST for action security_group_rules [ 936.212248] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cce60a92-c34e-445e-97a5-b8cfceb8b2b3 with Priority: HIGHEST for action security_group_members [ 936.212343] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c24aad4d-bc4c-4934-b881-210e94ee9ce6 with Priority: HIGHEST for action port [ 936.212632] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cce60a92-c34e-445e-97a5-b8cfceb8b2b3 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.212755] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cce60a92-c34e-445e-97a5-b8cfceb8b2b3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.212840] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cce60a92-c34e-445e-97a5-b8cfceb8b2b3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.213194] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cce60a92-c34e-445e-97a5-b8cfceb8b2b3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.213316] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cce60a92-c34e-445e-97a5-b8cfceb8b2b3',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.215605] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-cce60a92-c34e-445e-97a5-b8cfceb8b2b3 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.215605] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cce60a92-c34e-445e-97a5-b8cfceb8b2b3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.215605] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cce60a92-c34e-445e-97a5-b8cfceb8b2b3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.215605] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cce60a92-c34e-445e-97a5-b8cfceb8b2b3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.215605] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.215605] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.215605] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.215605] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.215605] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.215890] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cce60a92-c34e-445e-97a5-b8cfceb8b2b3',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.216452] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-c24aad4d-bc4c-4934-b881-210e94ee9ce6 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.216557] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c24aad4d-bc4c-4934-b881-210e94ee9ce6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.216622] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c24aad4d-bc4c-4934-b881-210e94ee9ce6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.216765] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c24aad4d-bc4c-4934-b881-210e94ee9ce6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.216837] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c24aad4d-bc4c-4934-b881-210e94ee9ce6',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.245440] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.245440] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.245440] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.247766] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.247766] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.247766] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b36fec68-8054-450e-a4b6-c700b29fd114 is going to be updated. [ 936.279128] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.279128] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.279128] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.279303] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.279333] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.289198] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b36fec68-8054-450e-a4b6-c700b29fd114 in Status: IN_PROGRESS for 2s [ 936.562023] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.562197] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.562271] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.562548] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.562729] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.562832] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.562896] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.563064] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.563335] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.563335] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.563414] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.563489] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.563534] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.564690] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.566375] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.566375] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.566375] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.566375] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.566375] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.566375] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.566375] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.715380] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-cce60a92-c34e-445e-97a5-b8cfceb8b2b3 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.715566] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cce60a92-c34e-445e-97a5-b8cfceb8b2b3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.719132] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c24aad4d-bc4c-4934-b881-210e94ee9ce6 with status ACTIVE [ 936.719530] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.719711] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.719852] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.719994] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.720100] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.720283] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.720381] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.720442] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.720618] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.720697] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.720878] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.720969] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.721042] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.721183] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.721255] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.721338] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c24aad4d-bc4c-4934-b881-210e94ee9ce6 is going to be updated. [ 936.722485] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cce60a92-c34e-445e-97a5-b8cfceb8b2b3',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.747026] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.747184] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.747359] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.747708] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.747927] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.748208] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c24aad4d-bc4c-4934-b881-210e94ee9ce6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.059558] env[65065]: INFO networking_nsxv3.common.synchronization [req-8f6d9e8e-c598-40aa-b422-9e5c8c172596 req-18e4500b-584a-4185-8547-c0d1357fe9e8 tempest-ServersTestJSON-1126920631 tempest-ServersTestJSON-1126920631-project-member] Enqueued Resource ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 with Priority: HIGHEST for action security_group_members [ 937.060517] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 with Priority: HIGHEST for action security_group_members [ 937.060517] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e5f0086-b1e3-4f00-8207-8306f153d0e4 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.060683] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.061012] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.061012] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.061191] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.061615] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.061615] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.061615] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.061615] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.061926] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e5f0086-b1e3-4f00-8207-8306f153d0e4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.069919] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f: rpc.has_security_group_logging(os_id): False [ 937.090875] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.090875] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.090875] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.090875] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.090875] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.090875] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.090875] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.090875] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.090875] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.090875] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.091369] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.091369] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.091369] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.091369] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.091369] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.091545] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.091644] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.091693] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.091825] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.092025] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.092322] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f is going to be updated. [ 937.161153] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.161336] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.161400] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.161640] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.161812] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.175195] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f in Status: IN_PROGRESS for 2s [ 937.225863] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cce60a92-c34e-445e-97a5-b8cfceb8b2b3',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.400312] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock network-381 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.400609] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "network-381" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.400686] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "network-381" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.400942] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "network-381" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.401230] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.401381] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.401523] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.401692] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.402388] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.402703] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 937.403449] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 937.403449] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 937.403449] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 937.403449] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 937.403449] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 937.403718] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 937.426309] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 937.427128] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 937.427128] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 937.427128] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "network-381" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.427484] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock port-af99109f-c0d7-48df-912b-f7ceb33153c7 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.427970] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "port-af99109f-c0d7-48df-912b-f7ceb33153c7" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.427970] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "port-af99109f-c0d7-48df-912b-f7ceb33153c7" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.428703] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "port-af99109f-c0d7-48df-912b-f7ceb33153c7" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.428703] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('af99109f-c0d7-48df-912b-f7ceb33153c7',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.473249] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ffd44fac-c762-408c-862b-ccea34e00947 in Status: SUCCESS [ 937.473468] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.565467] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1e5f0086-b1e3-4f00-8207-8306f153d0e4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.728483] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.728674] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.728718] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.728961] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.729095] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.729209] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cce60a92-c34e-445e-97a5-b8cfceb8b2b3 is going to be created. [ 937.756090] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.756279] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.756324] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.756538] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.756745] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.771698] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cce60a92-c34e-445e-97a5-b8cfceb8b2b3 in Status: UNINITIALIZED for 2s [ 937.930709] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.930979] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.931585] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.931585] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.931585] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.931728] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Segment Port af99109f-c0d7-48df-912b-f7ceb33153c7 not found, creating... [ 937.931989] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.932168] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.932285] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.932511] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.932651] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.932950] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.933122] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.933239] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.933452] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.933596] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.933728] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Resource: SegmentPort with ID: af99109f-c0d7-48df-912b-f7ceb33153c7 is going to be created. [ 937.949613] env[65065]: INFO networking_nsxv3.common.synchronization [req-99d57965-9d53-4a1c-bfa0-6ebc80a788e5 req-e7c8d897-d2b7-41f8-bb1c-fb30a56a0dcd tempest-MultipleCreateTestJSON-605630201 tempest-MultipleCreateTestJSON-605630201-project-member] Enqueued Resource ID: d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f with Priority: HIGHEST for action security_group_members [ 937.950280] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f with Priority: HIGHEST for action security_group_members [ 937.950668] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.950799] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.950878] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.951143] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.951322] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.951443] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.951545] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.951756] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.951864] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.951982] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.965268] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.965422] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.965578] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.965935] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.966240] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.966521] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "port-af99109f-c0d7-48df-912b-f7ceb33153c7" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.068689] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1e5f0086-b1e3-4f00-8207-8306f153d0e4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.300271] env[65065]: INFO networking_nsxv3.common.synchronization [req-33024720-fc11-432e-85d4-3540a12c01c4 req-8e2d046e-acfc-4a68-9af2-e958c4c89bca tempest-MultipleCreateTestJSON-605630201 tempest-MultipleCreateTestJSON-605630201-project-member] Enqueued Resource ID: d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f with Priority: HIGHEST for action security_group_members [ 938.301581] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b36fec68-8054-450e-a4b6-c700b29fd114 in Status: SUCCESS [ 938.301581] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b36fec68-8054-450e-a4b6-c700b29fd114" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.302026] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f with Priority: HIGHEST for action security_group_members [ 938.302331] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.302431] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.455559] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.572706] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.572884] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.572884] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.573104] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.573236] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.573236] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 is going to be updated. [ 938.626824] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.627018] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.627125] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.627253] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.627405] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.644248] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 in Status: IN_PROGRESS for 2s [ 938.716666] env[65065]: INFO networking_nsxv3.common.synchronization [req-8f6d9e8e-c598-40aa-b422-9e5c8c172596 req-eb79799c-f745-460d-bb30-c4d9df3b1280 service nova] Enqueued Resource ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 with Priority: HIGHEST for action security_group_rules [ 938.716849] env[65065]: INFO networking_nsxv3.common.synchronization [req-8f6d9e8e-c598-40aa-b422-9e5c8c172596 req-eb79799c-f745-460d-bb30-c4d9df3b1280 service nova] Enqueued Resource ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 with Priority: HIGHEST for action security_group_members [ 938.716993] env[65065]: INFO networking_nsxv3.common.synchronization [req-8f6d9e8e-c598-40aa-b422-9e5c8c172596 req-eb79799c-f745-460d-bb30-c4d9df3b1280 service nova] Enqueued Resource ID: af99109f-c0d7-48df-912b-f7ceb33153c7 with Priority: HIGHEST for action port [ 938.717624] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 with Priority: HIGHEST for action security_group_rules [ 938.717767] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 with Priority: HIGHEST for action security_group_members [ 938.717863] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af99109f-c0d7-48df-912b-f7ceb33153c7 with Priority: HIGHEST for action port [ 938.718217] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1e5f0086-b1e3-4f00-8207-8306f153d0e4 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.718345] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.718411] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.718619] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.718703] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1e5f0086-b1e3-4f00-8207-8306f153d0e4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.720179] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e5f0086-b1e3-4f00-8207-8306f153d0e4 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.720301] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.721047] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-af99109f-c0d7-48df-912b-f7ceb33153c7 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.721047] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-af99109f-c0d7-48df-912b-f7ceb33153c7" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.721047] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-af99109f-c0d7-48df-912b-f7ceb33153c7" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.721047] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-af99109f-c0d7-48df-912b-f7ceb33153c7" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.721047] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('af99109f-c0d7-48df-912b-f7ceb33153c7',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.957023] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.191248] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f in Status: SUCCESS [ 939.191458] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.224050] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port af99109f-c0d7-48df-912b-f7ceb33153c7 with status ACTIVE [ 939.224313] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.224447] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.224514] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.224724] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.224808] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.224975] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.225078] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.225137] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.225278] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.225349] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.225523] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.225611] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.225668] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.225803] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.225870] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.225965] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: af99109f-c0d7-48df-912b-f7ceb33153c7 is going to be updated. [ 939.230847] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e5f0086-b1e3-4f00-8207-8306f153d0e4 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.230847] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.251384] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.251532] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.251584] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.251799] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.251951] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.252155] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-af99109f-c0d7-48df-912b-f7ceb33153c7" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.459619] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.459886] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.459886] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.460564] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.460564] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.460564] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f is going to be updated. [ 939.490636] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.490803] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.490852] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.491066] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.491205] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.500294] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f in Status: IN_PROGRESS for 2s [ 939.516626] env[65065]: INFO networking_nsxv3.common.synchronization [req-5d63d5ff-ee70-48bd-82e7-deeec290a233 req-75ed5a71-1fb1-4645-b035-1c353c12ff79 tempest-AttachInterfacesUnderV243Test-339300557 tempest-AttachInterfacesUnderV243Test-339300557-project-member] Enqueued Resource ID: edcd6c4a-2692-4c72-ae97-49015334375d with Priority: HIGHEST for action security_group_members [ 939.517320] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: edcd6c4a-2692-4c72-ae97-49015334375d with Priority: HIGHEST for action security_group_members [ 939.517565] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-edcd6c4a-2692-4c72-ae97-49015334375d taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.517687] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-edcd6c4a-2692-4c72-ae97-49015334375d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.517754] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-edcd6c4a-2692-4c72-ae97-49015334375d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.518016] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-edcd6c4a-2692-4c72-ae97-49015334375d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.525407] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.525407] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.525407] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.525407] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.525407] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.525407] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('edcd6c4a-2692-4c72-ae97-49015334375d',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.783797] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cce60a92-c34e-445e-97a5-b8cfceb8b2b3 in Status: SUCCESS [ 939.784064] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cce60a92-c34e-445e-97a5-b8cfceb8b2b3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.784599] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cce60a92-c34e-445e-97a5-b8cfceb8b2b3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.784827] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cce60a92-c34e-445e-97a5-b8cfceb8b2b3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.785082] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.785170] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.785887] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.785887] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.785887] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.785887] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cce60a92-c34e-445e-97a5-b8cfceb8b2b3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.785887] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cce60a92-c34e-445e-97a5-b8cfceb8b2b3',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.899138] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock network-154 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.899345] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "network-154" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.899544] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "network-154" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.899870] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "network-154" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.900302] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.900575] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.900840] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.900943] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.901129] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.901357] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 939.901473] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 939.901583] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 939.901691] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 939.901817] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 939.901943] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 939.902071] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 939.923327] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 939.923426] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 939.923572] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 939.923792] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "network-154" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.924206] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock port-88795fd9-14f0-460f-a75a-d0a6cf247cdf taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.924458] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "port-88795fd9-14f0-460f-a75a-d0a6cf247cdf" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.924908] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "port-88795fd9-14f0-460f-a75a-d0a6cf247cdf" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.924908] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "port-88795fd9-14f0-460f-a75a-d0a6cf247cdf" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.925101] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('88795fd9-14f0-460f-a75a-d0a6cf247cdf',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.024052] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.024227] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.024328] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.024563] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.024973] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.025218] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.025328] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.025400] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.025548] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.025631] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.026025] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: edcd6c4a-2692-4c72-ae97-49015334375d already deleted. [ 940.026861] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-edcd6c4a-2692-4c72-ae97-49015334375d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.287805] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cce60a92-c34e-445e-97a5-b8cfceb8b2b3',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.428149] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.428626] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.428884] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.429293] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.429583] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.430856] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Segment Port 88795fd9-14f0-460f-a75a-d0a6cf247cdf not found, creating... [ 940.431236] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.431516] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.431697] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.432023] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.432257] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.432673] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.432844] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.432996] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.434370] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.434370] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.434370] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Resource: SegmentPort with ID: 88795fd9-14f0-460f-a75a-d0a6cf247cdf is going to be created. [ 940.461311] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.461311] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.461311] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.461845] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.461845] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.462682] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "port-88795fd9-14f0-460f-a75a-d0a6cf247cdf" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.657890] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 in Status: SUCCESS [ 940.657890] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.657890] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.657890] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.658095] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.658182] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.658314] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.658627] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.658761] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.658927] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e5f0086-b1e3-4f00-8207-8306f153d0e4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.790025] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cce60a92-c34e-445e-97a5-b8cfceb8b2b3: rpc.has_security_group_logging(os_id): False [ 940.812053] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.812238] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.812500] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.812633] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.812739] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.813037] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.813445] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.813445] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.813445] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.813574] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.813656] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cce60a92-c34e-445e-97a5-b8cfceb8b2b3 is going to be created. [ 940.888713] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.888853] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.888928] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.889183] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.889380] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.924558] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cce60a92-c34e-445e-97a5-b8cfceb8b2b3 in Status: IN_PROGRESS for 2s [ 941.161752] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1e5f0086-b1e3-4f00-8207-8306f153d0e4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.215802] env[65065]: INFO networking_nsxv3.common.synchronization [req-5d63d5ff-ee70-48bd-82e7-deeec290a233 req-616cefa9-b272-4a5a-854b-21fb1a0e266b service nova] Enqueued Resource ID: edcd6c4a-2692-4c72-ae97-49015334375d with Priority: HIGHEST for action security_group_rules [ 941.216151] env[65065]: INFO networking_nsxv3.common.synchronization [req-5d63d5ff-ee70-48bd-82e7-deeec290a233 req-616cefa9-b272-4a5a-854b-21fb1a0e266b service nova] Enqueued Resource ID: edcd6c4a-2692-4c72-ae97-49015334375d with Priority: HIGHEST for action security_group_members [ 941.216151] env[65065]: INFO networking_nsxv3.common.synchronization [req-5d63d5ff-ee70-48bd-82e7-deeec290a233 req-616cefa9-b272-4a5a-854b-21fb1a0e266b service nova] Enqueued Resource ID: 88795fd9-14f0-460f-a75a-d0a6cf247cdf with Priority: HIGHEST for action port [ 941.216608] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: edcd6c4a-2692-4c72-ae97-49015334375d with Priority: HIGHEST for action security_group_rules [ 941.217291] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: edcd6c4a-2692-4c72-ae97-49015334375d with Priority: HIGHEST for action security_group_members [ 941.217291] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88795fd9-14f0-460f-a75a-d0a6cf247cdf with Priority: HIGHEST for action port [ 941.217681] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-edcd6c4a-2692-4c72-ae97-49015334375d taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.217795] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-edcd6c4a-2692-4c72-ae97-49015334375d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.218611] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-edcd6c4a-2692-4c72-ae97-49015334375d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.218611] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-edcd6c4a-2692-4c72-ae97-49015334375d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.218611] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('edcd6c4a-2692-4c72-ae97-49015334375d',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.219491] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-edcd6c4a-2692-4c72-ae97-49015334375d taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.219625] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-edcd6c4a-2692-4c72-ae97-49015334375d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.219685] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-edcd6c4a-2692-4c72-ae97-49015334375d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.219867] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-edcd6c4a-2692-4c72-ae97-49015334375d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.220076] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.220182] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.220252] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.220404] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.220579] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.220579] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('edcd6c4a-2692-4c72-ae97-49015334375d',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.222683] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-88795fd9-14f0-460f-a75a-d0a6cf247cdf taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.222683] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-88795fd9-14f0-460f-a75a-d0a6cf247cdf" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.222830] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-88795fd9-14f0-460f-a75a-d0a6cf247cdf" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.223987] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-88795fd9-14f0-460f-a75a-d0a6cf247cdf" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.223987] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('88795fd9-14f0-460f-a75a-d0a6cf247cdf',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.511017] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f in Status: SUCCESS [ 941.511387] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.511387] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.511654] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.511935] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.512102] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.512189] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.512378] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.512492] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.512630] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.664943] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1e5f0086-b1e3-4f00-8207-8306f153d0e4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.730783] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-edcd6c4a-2692-4c72-ae97-49015334375d taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.730783] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-edcd6c4a-2692-4c72-ae97-49015334375d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.730783] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('edcd6c4a-2692-4c72-ae97-49015334375d',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.731316] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 88795fd9-14f0-460f-a75a-d0a6cf247cdf with status ACTIVE [ 941.731522] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.731661] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.731726] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.731918] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.731997] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.732178] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.732276] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.732325] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.732463] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.732533] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.732700] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.732793] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.732842] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.733359] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.733359] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.733359] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 88795fd9-14f0-460f-a75a-d0a6cf247cdf is going to be updated. [ 941.755906] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.756032] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.756032] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.756238] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.756471] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.756647] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-88795fd9-14f0-460f-a75a-d0a6cf247cdf" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.015741] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.016848] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.016983] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.017201] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.017655] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.017655] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.017655] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.017795] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.017838] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.017908] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.017964] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f is going to be updated. [ 942.049713] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.049713] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.049713] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.049713] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.049713] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.061622] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f in Status: IN_PROGRESS for 2s [ 942.150495] env[65065]: INFO networking_nsxv3.common.synchronization [req-e9a1be13-aee6-4dc0-8912-a85a8d0bb595 req-91fba9d7-d39e-4d45-9c1d-4840f3749178 tempest-ServerActionsTestOtherB-1640131964 tempest-ServerActionsTestOtherB-1640131964-project-member] Enqueued Resource ID: b95b4f27-41f6-4a01-a1aa-aa16348ad807 with Priority: HIGHEST for action security_group_members [ 942.150945] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b95b4f27-41f6-4a01-a1aa-aa16348ad807 with Priority: HIGHEST for action security_group_members [ 942.152330] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-b95b4f27-41f6-4a01-a1aa-aa16348ad807 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.152610] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b95b4f27-41f6-4a01-a1aa-aa16348ad807" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.152610] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b95b4f27-41f6-4a01-a1aa-aa16348ad807" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.152777] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b95b4f27-41f6-4a01-a1aa-aa16348ad807" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.152929] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.153059] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.153112] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.153228] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.153307] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.153404] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b95b4f27-41f6-4a01-a1aa-aa16348ad807',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.167328] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.168845] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.168845] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.168845] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.168845] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.168845] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 is going to be updated. [ 942.200045] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.200146] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.200246] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.200826] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.201247] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.213461] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 in Status: IN_PROGRESS for 2s [ 942.235426] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('edcd6c4a-2692-4c72-ae97-49015334375d',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.566991] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock network-8 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.567548] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "network-8" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.567548] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "network-8" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.567705] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "network-8" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.567950] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.568271] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.568507] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.568658] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.568802] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.569028] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 942.569193] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 942.569331] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 942.569483] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 942.569612] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 942.569717] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 942.569919] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 942.600553] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 942.602039] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 942.602039] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 942.602039] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "network-8" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.602039] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock port-996eeb78-3332-415f-bf65-30391e16d0bd taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.602039] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "port-996eeb78-3332-415f-bf65-30391e16d0bd" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.602039] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "port-996eeb78-3332-415f-bf65-30391e16d0bd" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.602478] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "port-996eeb78-3332-415f-bf65-30391e16d0bd" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.602478] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('996eeb78-3332-415f-bf65-30391e16d0bd',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.660141] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.660141] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.660141] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.660141] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.660141] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.660141] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.660141] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.660141] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.660141] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.660141] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.660141] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b95b4f27-41f6-4a01-a1aa-aa16348ad807 is going to be updated. [ 942.701837] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.701837] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.701837] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.702246] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.702558] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.715078] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b95b4f27-41f6-4a01-a1aa-aa16348ad807 in Status: IN_PROGRESS for 2s [ 942.738968] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.739354] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.739354] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.739798] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.739959] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.740117] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: edcd6c4a-2692-4c72-ae97-49015334375d is going to be created. [ 942.771346] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.771542] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.771588] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.772071] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.773078] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.785687] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: edcd6c4a-2692-4c72-ae97-49015334375d in Status: UNINITIALIZED for 2s [ 942.937837] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cce60a92-c34e-445e-97a5-b8cfceb8b2b3 in Status: SUCCESS [ 942.938082] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cce60a92-c34e-445e-97a5-b8cfceb8b2b3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.105049] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.105228] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.105330] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.105684] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.105839] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.105996] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Segment Port 996eeb78-3332-415f-bf65-30391e16d0bd not found, creating... [ 943.106282] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.106441] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.106557] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.106835] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.106982] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.107284] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.107520] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.107635] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.107853] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.107988] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.108274] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Resource: SegmentPort with ID: 996eeb78-3332-415f-bf65-30391e16d0bd is going to be created. [ 943.157821] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.158087] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.158248] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.158544] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.158781] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.159048] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "port-996eeb78-3332-415f-bf65-30391e16d0bd" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.889083] env[65065]: INFO networking_nsxv3.common.synchronization [req-e9a1be13-aee6-4dc0-8912-a85a8d0bb595 req-56d0fe5d-6ef3-4303-8d78-3ca043ebb6ba service nova] Enqueued Resource ID: b95b4f27-41f6-4a01-a1aa-aa16348ad807 with Priority: HIGHEST for action security_group_rules [ 943.889580] env[65065]: INFO networking_nsxv3.common.synchronization [req-e9a1be13-aee6-4dc0-8912-a85a8d0bb595 req-56d0fe5d-6ef3-4303-8d78-3ca043ebb6ba service nova] Enqueued Resource ID: b95b4f27-41f6-4a01-a1aa-aa16348ad807 with Priority: HIGHEST for action security_group_members [ 943.889580] env[65065]: INFO networking_nsxv3.common.synchronization [req-e9a1be13-aee6-4dc0-8912-a85a8d0bb595 req-56d0fe5d-6ef3-4303-8d78-3ca043ebb6ba service nova] Enqueued Resource ID: 996eeb78-3332-415f-bf65-30391e16d0bd with Priority: HIGHEST for action port [ 943.890423] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b95b4f27-41f6-4a01-a1aa-aa16348ad807 with Priority: HIGHEST for action security_group_rules [ 943.890669] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b95b4f27-41f6-4a01-a1aa-aa16348ad807 with Priority: HIGHEST for action security_group_members [ 943.890825] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 996eeb78-3332-415f-bf65-30391e16d0bd with Priority: HIGHEST for action port [ 943.891794] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b95b4f27-41f6-4a01-a1aa-aa16348ad807 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.892247] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b95b4f27-41f6-4a01-a1aa-aa16348ad807" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.892365] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b95b4f27-41f6-4a01-a1aa-aa16348ad807" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.892711] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b95b4f27-41f6-4a01-a1aa-aa16348ad807" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.892816] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b95b4f27-41f6-4a01-a1aa-aa16348ad807',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.894181] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-b95b4f27-41f6-4a01-a1aa-aa16348ad807 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.894371] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b95b4f27-41f6-4a01-a1aa-aa16348ad807" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.894702] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-996eeb78-3332-415f-bf65-30391e16d0bd taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.894980] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-996eeb78-3332-415f-bf65-30391e16d0bd" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.895197] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-996eeb78-3332-415f-bf65-30391e16d0bd" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.896090] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-996eeb78-3332-415f-bf65-30391e16d0bd" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.896090] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('996eeb78-3332-415f-bf65-30391e16d0bd',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.072242] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f in Status: SUCCESS [ 944.072242] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f deletion is rescheduled due to dependency. [ 944.072327] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.224356] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 in Status: SUCCESS [ 944.225153] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.225153] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.225153] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.225379] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.225562] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.225735] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.225837] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.225944] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.226102] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.226259] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1e5f0086-b1e3-4f00-8207-8306f153d0e4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.398433] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-b95b4f27-41f6-4a01-a1aa-aa16348ad807 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.398568] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b95b4f27-41f6-4a01-a1aa-aa16348ad807" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.398783] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 996eeb78-3332-415f-bf65-30391e16d0bd with status ACTIVE [ 944.398927] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.399046] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.399114] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.399332] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.399423] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.399665] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.399762] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.399827] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.400104] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.400216] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.400408] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.400536] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.400606] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.400751] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.400827] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.400911] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 996eeb78-3332-415f-bf65-30391e16d0bd is going to be updated. [ 944.426060] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.426228] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.426268] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.426492] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.426629] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.426785] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-996eeb78-3332-415f-bf65-30391e16d0bd" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.725526] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b95b4f27-41f6-4a01-a1aa-aa16348ad807 in Status: SUCCESS [ 944.725722] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b95b4f27-41f6-4a01-a1aa-aa16348ad807 deletion is rescheduled due to dependency. [ 944.725813] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b95b4f27-41f6-4a01-a1aa-aa16348ad807" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.725995] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b95b4f27-41f6-4a01-a1aa-aa16348ad807" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.726221] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b95b4f27-41f6-4a01-a1aa-aa16348ad807" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.726426] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.726546] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.726627] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.726779] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.726859] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.726965] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b95b4f27-41f6-4a01-a1aa-aa16348ad807',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.729347] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e5f0086-b1e3-4f00-8207-8306f153d0e4 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.729560] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.729638] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.729787] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.729945] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.730065] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.730126] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.730262] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.730427] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.730427] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.730621] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e5f0086-b1e3-4f00-8207-8306f153d0e4 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.730720] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.730777] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.730920] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.731100] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.731198] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.731257] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.731372] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.731448] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.731535] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.731664] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1e5f0086-b1e3-4f00-8207-8306f153d0e4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.798017] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: edcd6c4a-2692-4c72-ae97-49015334375d in Status: UNINITIALIZED for 4s [ 945.232408] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b95b4f27-41f6-4a01-a1aa-aa16348ad807',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.233984] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1e5f0086-b1e3-4f00-8207-8306f153d0e4: rpc.has_security_group_logging(os_id): False [ 945.257230] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.257230] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.257230] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.261123] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.261123] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.261123] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.261123] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.261123] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.261123] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.261123] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.261123] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.261123] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.261123] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.261123] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.261123] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.261123] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.261123] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.261679] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.261679] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.261679] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.261679] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 is going to be updated. [ 945.330346] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.330643] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.330744] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.330955] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.331123] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.345108] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 in Status: IN_PROGRESS for 2s [ 945.734323] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b95b4f27-41f6-4a01-a1aa-aa16348ad807',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.239823] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.240193] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.240193] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.240355] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.240446] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.240581] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b95b4f27-41f6-4a01-a1aa-aa16348ad807 is going to be updated. [ 946.274110] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.274380] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.274380] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.274613] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.274765] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.287030] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b95b4f27-41f6-4a01-a1aa-aa16348ad807 in Status: IN_PROGRESS for 2s [ 946.808454] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: edcd6c4a-2692-4c72-ae97-49015334375d in Status: SUCCESS [ 946.808769] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-edcd6c4a-2692-4c72-ae97-49015334375d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.808984] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-edcd6c4a-2692-4c72-ae97-49015334375d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.809440] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-edcd6c4a-2692-4c72-ae97-49015334375d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.809440] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.809625] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.809714] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.809964] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.810586] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.810654] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-edcd6c4a-2692-4c72-ae97-49015334375d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.810769] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('edcd6c4a-2692-4c72-ae97-49015334375d',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.315556] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('edcd6c4a-2692-4c72-ae97-49015334375d',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.365091] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 in Status: SUCCESS [ 947.365822] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.817707] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for edcd6c4a-2692-4c72-ae97-49015334375d: rpc.has_security_group_logging(os_id): False [ 947.843283] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.843547] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.843589] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.843879] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.843990] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.844357] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.844957] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.844957] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.844957] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.844957] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.845275] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: edcd6c4a-2692-4c72-ae97-49015334375d is going to be created. [ 947.922490] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.922711] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.922711] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.922946] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.923124] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.939932] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: edcd6c4a-2692-4c72-ae97-49015334375d in Status: IN_PROGRESS for 2s [ 948.297732] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b95b4f27-41f6-4a01-a1aa-aa16348ad807 in Status: SUCCESS [ 948.297957] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b95b4f27-41f6-4a01-a1aa-aa16348ad807" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.298235] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b95b4f27-41f6-4a01-a1aa-aa16348ad807" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.298374] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b95b4f27-41f6-4a01-a1aa-aa16348ad807" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.298654] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.298828] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.298828] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.298960] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.298995] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.299173] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b95b4f27-41f6-4a01-a1aa-aa16348ad807" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.299173] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b95b4f27-41f6-4a01-a1aa-aa16348ad807',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.802789] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b95b4f27-41f6-4a01-a1aa-aa16348ad807',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.892150] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 948.892380] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 949.305277] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b95b4f27-41f6-4a01-a1aa-aa16348ad807: rpc.has_security_group_logging(os_id): False [ 949.330901] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.331124] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.331236] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.331504] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.331617] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.332018] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.332166] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.332225] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.332545] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.332746] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.332859] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b95b4f27-41f6-4a01-a1aa-aa16348ad807 is going to be updated. [ 949.400268] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.400495] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.400759] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.400948] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.401209] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.418918] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b95b4f27-41f6-4a01-a1aa-aa16348ad807 in Status: IN_PROGRESS for 2s [ 949.955537] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: edcd6c4a-2692-4c72-ae97-49015334375d in Status: SUCCESS [ 949.955838] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-edcd6c4a-2692-4c72-ae97-49015334375d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.431779] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b95b4f27-41f6-4a01-a1aa-aa16348ad807 in Status: SUCCESS [ 951.431779] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b95b4f27-41f6-4a01-a1aa-aa16348ad807" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.554246] env[65065]: INFO networking_nsxv3.common.synchronization [req-2b4a624e-c365-4604-8cad-83dd72889e9f req-ee9c5b65-9102-47b2-bd43-d3ccafc19dbb tempest-ServersTestMultiNic-1110836678 tempest-ServersTestMultiNic-1110836678-project-member] Enqueued Resource ID: e9de3df0-a5b4-4be3-a63b-4d4baf532bbc with Priority: HIGHEST for action security_group_members [ 951.554963] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9de3df0-a5b4-4be3-a63b-4d4baf532bbc with Priority: HIGHEST for action security_group_members [ 951.555328] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.555497] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.555557] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.555788] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.555969] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.556054] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.556150] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.556280] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.556366] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.556480] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e9de3df0-a5b4-4be3-a63b-4d4baf532bbc',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.881466] env[65065]: INFO networking_nsxv3.common.synchronization [req-2b4a624e-c365-4604-8cad-83dd72889e9f req-32b4167e-d1de-48f3-9f70-838e56d318fe tempest-ServersTestMultiNic-1110836678 tempest-ServersTestMultiNic-1110836678-project-member] Enqueued Resource ID: e9de3df0-a5b4-4be3-a63b-4d4baf532bbc with Priority: HIGHEST for action security_group_members [ 951.882029] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9de3df0-a5b4-4be3-a63b-4d4baf532bbc with Priority: HIGHEST for action security_group_members [ 951.882318] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.882437] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.944888] env[65065]: INFO networking_nsxv3.common.synchronization [None req-7aa44dc9-e2a7-4357-89c5-102b63d97105 None None] Enqueued Resource ID: fc74b351-7a4f-45f3-adb7-3706d1e88415 with Priority: HIGHEST for action port [ 951.944888] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc74b351-7a4f-45f3-adb7-3706d1e88415 with Priority: HIGHEST for action port [ 951.944888] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-fc74b351-7a4f-45f3-adb7-3706d1e88415 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.944888] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fc74b351-7a4f-45f3-adb7-3706d1e88415" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.944888] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fc74b351-7a4f-45f3-adb7-3706d1e88415" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.944888] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fc74b351-7a4f-45f3-adb7-3706d1e88415" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.944888] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fc74b351-7a4f-45f3-adb7-3706d1e88415',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.058373] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.058622] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.058689] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.059197] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.059426] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.059710] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.059847] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.059911] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.060210] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.060360] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.060527] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e9de3df0-a5b4-4be3-a63b-4d4baf532bbc already deleted. [ 952.060678] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.061014] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.061176] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.061349] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.061452] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.061526] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.061671] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.061764] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.061860] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e9de3df0-a5b4-4be3-a63b-4d4baf532bbc',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.318938] env[65065]: INFO networking_nsxv3.common.synchronization [req-2b4a624e-c365-4604-8cad-83dd72889e9f req-f85e4a88-52f7-421b-a3d5-75c78b74c26e tempest-ServersTestMultiNic-1110836678 tempest-ServersTestMultiNic-1110836678-project-member] Enqueued Resource ID: e9de3df0-a5b4-4be3-a63b-4d4baf532bbc with Priority: HIGHEST for action security_group_members [ 952.319802] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9de3df0-a5b4-4be3-a63b-4d4baf532bbc with Priority: HIGHEST for action security_group_members [ 952.320168] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.320328] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.446618] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fc74b351-7a4f-45f3-adb7-3706d1e88415 [ 952.446961] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.447114] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.447198] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.447508] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.447635] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.447734] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fc74b351-7a4f-45f3-adb7-3706d1e88415 already deleted. [ 952.447816] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fc74b351-7a4f-45f3-adb7-3706d1e88415" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.506030] env[65065]: INFO networking_nsxv3.common.synchronization [req-c88db546-7ae9-4011-b529-59dbbb00598a req-a9d0a382-648a-4e05-aa93-d3b4973b39e2 tempest-ServersTestJSON-1126920631 tempest-ServersTestJSON-1126920631-project-member] Enqueued Resource ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 with Priority: HIGHEST for action security_group_members [ 952.506209] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 with Priority: HIGHEST for action security_group_members [ 952.506516] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e5f0086-b1e3-4f00-8207-8306f153d0e4 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.506666] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.506744] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.506942] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.507385] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.507503] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.507568] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.507735] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.507821] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.507930] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e5f0086-b1e3-4f00-8207-8306f153d0e4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.565895] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.566074] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.566192] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.566449] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.566593] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.566819] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.567078] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.567078] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.567242] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.567326] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.567446] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e9de3df0-a5b4-4be3-a63b-4d4baf532bbc already deleted. [ 952.567545] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.568117] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.568117] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.568117] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.568117] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.568117] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.568335] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.568335] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.568399] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e9de3df0-a5b4-4be3-a63b-4d4baf532bbc',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.718445] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock network-803 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.718849] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "network-803" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.718849] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "network-803" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.719054] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "network-803" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.719411] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.719612] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.719872] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.720142] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.720439] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.720562] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 952.720612] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 952.720705] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 952.721074] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 952.721074] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 952.721074] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 952.721227] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 952.742403] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 952.742631] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 952.742720] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 952.742891] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "network-803" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.743226] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock port-01246c73-ca08-4c66-a79f-c2b6762151d9 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.743398] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "port-01246c73-ca08-4c66-a79f-c2b6762151d9" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.743517] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "port-01246c73-ca08-4c66-a79f-c2b6762151d9" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.744014] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "port-01246c73-ca08-4c66-a79f-c2b6762151d9" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.744313] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('01246c73-ca08-4c66-a79f-c2b6762151d9',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.011317] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1e5f0086-b1e3-4f00-8207-8306f153d0e4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.072807] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.072807] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.072807] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.073040] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.073311] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.073594] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.073753] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.073855] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.074140] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.074273] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.074384] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e9de3df0-a5b4-4be3-a63b-4d4baf532bbc already deleted. [ 953.074544] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.250028] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.250028] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.250028] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.250028] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.250028] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.250028] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Segment Port 01246c73-ca08-4c66-a79f-c2b6762151d9 not found, creating... [ 953.250028] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.250028] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.250028] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.250028] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.250028] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.251127] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.251127] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.251127] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.252313] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.252313] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.252313] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Resource: SegmentPort with ID: 01246c73-ca08-4c66-a79f-c2b6762151d9 is going to be created. [ 953.283487] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.283583] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.283715] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.283967] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.284323] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.284606] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "port-01246c73-ca08-4c66-a79f-c2b6762151d9" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.350828] env[65065]: INFO networking_nsxv3.common.synchronization [None req-57a00c1d-4ceb-438d-b3f7-aa109825f294 tempest-ServerActionsV293TestJSON-337812631 tempest-ServerActionsV293TestJSON-337812631-project-member] Enqueued Resource ID: 37c3f83a-5710-4c20-abeb-08e60639bed8 with Priority: HIGHEST for action security_group_rules [ 953.351833] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37c3f83a-5710-4c20-abeb-08e60639bed8 with Priority: HIGHEST for action security_group_rules [ 953.352237] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-37c3f83a-5710-4c20-abeb-08e60639bed8 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.352364] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-37c3f83a-5710-4c20-abeb-08e60639bed8" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.352439] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-37c3f83a-5710-4c20-abeb-08e60639bed8" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.352801] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-37c3f83a-5710-4c20-abeb-08e60639bed8" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.352801] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('37c3f83a-5710-4c20-abeb-08e60639bed8',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.515897] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1e5f0086-b1e3-4f00-8207-8306f153d0e4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.585543] env[65065]: INFO networking_nsxv3.common.synchronization [None req-8e484eb6-3e0e-4987-8b78-96a6b82de351 tempest-ServerActionsV293TestJSON-337812631 tempest-ServerActionsV293TestJSON-337812631-project-member] Enqueued Resource ID: 37c3f83a-5710-4c20-abeb-08e60639bed8 with Priority: HIGHEST for action security_group_rules [ 953.586624] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37c3f83a-5710-4c20-abeb-08e60639bed8 with Priority: HIGHEST for action security_group_rules [ 953.587020] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-37c3f83a-5710-4c20-abeb-08e60639bed8 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.587116] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-37c3f83a-5710-4c20-abeb-08e60639bed8" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.872857] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.872965] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.873026] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.873209] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.873303] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.873397] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 37c3f83a-5710-4c20-abeb-08e60639bed8 already deleted. [ 953.873493] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-37c3f83a-5710-4c20-abeb-08e60639bed8" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.873693] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-37c3f83a-5710-4c20-abeb-08e60639bed8" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.873789] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-37c3f83a-5710-4c20-abeb-08e60639bed8" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.873870] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('37c3f83a-5710-4c20-abeb-08e60639bed8',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.987382] env[65065]: INFO networking_nsxv3.common.synchronization [req-2b4a624e-c365-4604-8cad-83dd72889e9f req-e06c9d7b-4700-4cb4-b4be-6b636939ac4d service nova] Enqueued Resource ID: e9de3df0-a5b4-4be3-a63b-4d4baf532bbc with Priority: HIGHEST for action security_group_rules [ 953.987575] env[65065]: INFO networking_nsxv3.common.synchronization [req-2b4a624e-c365-4604-8cad-83dd72889e9f req-e06c9d7b-4700-4cb4-b4be-6b636939ac4d service nova] Enqueued Resource ID: e9de3df0-a5b4-4be3-a63b-4d4baf532bbc with Priority: HIGHEST for action security_group_members [ 953.987740] env[65065]: INFO networking_nsxv3.common.synchronization [req-2b4a624e-c365-4604-8cad-83dd72889e9f req-e06c9d7b-4700-4cb4-b4be-6b636939ac4d service nova] Enqueued Resource ID: 01246c73-ca08-4c66-a79f-c2b6762151d9 with Priority: HIGHEST for action port [ 953.988310] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9de3df0-a5b4-4be3-a63b-4d4baf532bbc with Priority: HIGHEST for action security_group_rules [ 953.988443] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9de3df0-a5b4-4be3-a63b-4d4baf532bbc with Priority: HIGHEST for action security_group_members [ 953.988639] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01246c73-ca08-4c66-a79f-c2b6762151d9 with Priority: HIGHEST for action port [ 953.988802] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.988920] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.988982] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.989645] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.989686] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e9de3df0-a5b4-4be3-a63b-4d4baf532bbc',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.990857] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.990979] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.991060] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.991233] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.991651] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.991799] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.991883] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.992072] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.992697] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.992799] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e9de3df0-a5b4-4be3-a63b-4d4baf532bbc',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.994212] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-01246c73-ca08-4c66-a79f-c2b6762151d9 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.994308] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-01246c73-ca08-4c66-a79f-c2b6762151d9" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.994363] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-01246c73-ca08-4c66-a79f-c2b6762151d9" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.994517] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-01246c73-ca08-4c66-a79f-c2b6762151d9" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.994593] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('01246c73-ca08-4c66-a79f-c2b6762151d9',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.019817] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.019967] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.020035] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.020584] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.020763] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.020897] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 is going to be updated. [ 954.050803] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.050956] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.051025] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.051222] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.051423] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.062163] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 in Status: IN_PROGRESS for 2s [ 954.278704] env[65065]: INFO networking_nsxv3.common.synchronization [None req-5f5313fb-e66b-492d-95fe-73c2ab132d47 None None] Enqueued Resource ID: c4941e04-cf08-463d-8560-aae57d53451c with Priority: HIGHEST for action port [ 954.279287] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4941e04-cf08-463d-8560-aae57d53451c with Priority: HIGHEST for action port [ 954.279707] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-c4941e04-cf08-463d-8560-aae57d53451c taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.279861] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c4941e04-cf08-463d-8560-aae57d53451c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.279952] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c4941e04-cf08-463d-8560-aae57d53451c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.280294] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c4941e04-cf08-463d-8560-aae57d53451c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.280384] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c4941e04-cf08-463d-8560-aae57d53451c',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.399998] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.400091] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.400183] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.400423] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.400809] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.400809] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 37c3f83a-5710-4c20-abeb-08e60639bed8 already deleted. [ 954.400809] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-37c3f83a-5710-4c20-abeb-08e60639bed8" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.495181] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e9de3df0-a5b4-4be3-a63b-4d4baf532bbc',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.498144] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.498287] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.500081] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 01246c73-ca08-4c66-a79f-c2b6762151d9 with status ACTIVE [ 954.500081] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.500081] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.500081] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.500081] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.500081] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.500081] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.500081] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.500081] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.500519] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.500519] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.500643] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.500910] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.500970] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.501166] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.501295] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.501422] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 01246c73-ca08-4c66-a79f-c2b6762151d9 is going to be updated. [ 954.532686] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.532975] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.532975] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.533289] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.533526] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.533851] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-01246c73-ca08-4c66-a79f-c2b6762151d9" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.784292] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c4941e04-cf08-463d-8560-aae57d53451c [ 954.784292] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.784292] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.784292] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.784292] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.784292] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.784292] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c4941e04-cf08-463d-8560-aae57d53451c already deleted. [ 954.784292] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c4941e04-cf08-463d-8560-aae57d53451c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.870778] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock network-107 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.871307] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "network-107" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.871307] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "network-107" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.872028] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "network-107" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.872028] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.872028] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.872028] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.872241] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.872393] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.872573] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 954.872715] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 954.872906] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 954.872999] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 954.873077] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 954.873159] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 954.873289] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 954.895173] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 954.895173] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 954.895477] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 954.895477] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "network-107" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.895891] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock port-c9918eb0-e602-4efa-9c0c-c7f7992f7602 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.895891] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "port-c9918eb0-e602-4efa-9c0c-c7f7992f7602" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.896091] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "port-c9918eb0-e602-4efa-9c0c-c7f7992f7602" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.896290] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "port-c9918eb0-e602-4efa-9c0c-c7f7992f7602" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.896423] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c9918eb0-e602-4efa-9c0c-c7f7992f7602',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.999368] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e9de3df0-a5b4-4be3-a63b-4d4baf532bbc',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.398641] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.398935] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.399168] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.399596] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.399700] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.399866] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Segment Port c9918eb0-e602-4efa-9c0c-c7f7992f7602 not found, creating... [ 955.400165] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.400331] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.400447] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.400673] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.400807] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.401149] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.401312] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.401426] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.401645] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.401806] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.401965] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Resource: SegmentPort with ID: c9918eb0-e602-4efa-9c0c-c7f7992f7602 is going to be created. [ 955.425188] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.425453] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.425647] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.426033] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.426365] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.427176] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "port-c9918eb0-e602-4efa-9c0c-c7f7992f7602" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.503035] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.503226] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.503299] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.503554] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.503653] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.503873] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e9de3df0-a5b4-4be3-a63b-4d4baf532bbc is going to be created. [ 955.539833] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.540422] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.540632] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.540862] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.541045] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.551870] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9de3df0-a5b4-4be3-a63b-4d4baf532bbc in Status: UNINITIALIZED for 2s [ 956.074647] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 in Status: SUCCESS [ 956.074868] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.115137] env[65065]: INFO networking_nsxv3.common.synchronization [req-2b4a624e-c365-4604-8cad-83dd72889e9f req-2b23fca3-c89b-4287-8408-19b13071f323 service nova] Enqueued Resource ID: e9de3df0-a5b4-4be3-a63b-4d4baf532bbc with Priority: HIGHEST for action security_group_rules [ 956.115323] env[65065]: INFO networking_nsxv3.common.synchronization [req-2b4a624e-c365-4604-8cad-83dd72889e9f req-2b23fca3-c89b-4287-8408-19b13071f323 service nova] Enqueued Resource ID: e9de3df0-a5b4-4be3-a63b-4d4baf532bbc with Priority: HIGHEST for action security_group_members [ 956.115465] env[65065]: INFO networking_nsxv3.common.synchronization [req-2b4a624e-c365-4604-8cad-83dd72889e9f req-2b23fca3-c89b-4287-8408-19b13071f323 service nova] Enqueued Resource ID: c9918eb0-e602-4efa-9c0c-c7f7992f7602 with Priority: HIGHEST for action port [ 956.115992] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9de3df0-a5b4-4be3-a63b-4d4baf532bbc with Priority: HIGHEST for action security_group_rules [ 956.116141] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9de3df0-a5b4-4be3-a63b-4d4baf532bbc with Priority: HIGHEST for action security_group_members [ 956.116239] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9918eb0-e602-4efa-9c0c-c7f7992f7602 with Priority: HIGHEST for action port [ 956.116512] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.116954] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.117587] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.117698] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.117967] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-c9918eb0-e602-4efa-9c0c-c7f7992f7602 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.118058] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c9918eb0-e602-4efa-9c0c-c7f7992f7602" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.118133] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c9918eb0-e602-4efa-9c0c-c7f7992f7602" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.118333] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c9918eb0-e602-4efa-9c0c-c7f7992f7602" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.118418] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c9918eb0-e602-4efa-9c0c-c7f7992f7602',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.620136] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c9918eb0-e602-4efa-9c0c-c7f7992f7602 with status ACTIVE [ 956.620668] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.620815] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.620886] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.621449] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.621663] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.621888] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.622370] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.622370] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.622370] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.622514] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.622605] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.622717] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.622717] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.622850] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.622920] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.623015] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c9918eb0-e602-4efa-9c0c-c7f7992f7602 is going to be updated. [ 956.644721] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.645149] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.645230] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.645521] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.645706] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.645917] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c9918eb0-e602-4efa-9c0c-c7f7992f7602" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.995151] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock network-803 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.995364] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "network-803" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.995505] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "network-803" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.996702] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "network-803" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.996702] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.996702] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.996702] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.996920] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.997066] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.997223] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 956.997396] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 956.997558] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 956.997682] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 956.997792] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 956.997906] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 956.998048] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 957.018092] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 957.018264] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 957.018400] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 957.018566] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "network-803" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.018871] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock port-c4715e61-5115-4f6c-8795-883623e552c9 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.020556] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "port-c4715e61-5115-4f6c-8795-883623e552c9" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.020556] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "port-c4715e61-5115-4f6c-8795-883623e552c9" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.020556] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "port-c4715e61-5115-4f6c-8795-883623e552c9" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.020556] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c4715e61-5115-4f6c-8795-883623e552c9',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.524255] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.524255] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.524255] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.524567] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.524567] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.525120] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Segment Port c4715e61-5115-4f6c-8795-883623e552c9 not found, creating... [ 957.525120] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.525120] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.525294] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.525438] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.525705] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.525845] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.526222] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.526222] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.526594] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.526859] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.526951] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Resource: SegmentPort with ID: c4715e61-5115-4f6c-8795-883623e552c9 is going to be created. [ 957.551413] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.551413] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.551413] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.551657] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.551914] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.552420] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "port-c4715e61-5115-4f6c-8795-883623e552c9" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.562874] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9de3df0-a5b4-4be3-a63b-4d4baf532bbc in Status: SUCCESS [ 957.563115] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.563280] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.563495] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.563687] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.563804] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.563866] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.564036] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.564118] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.564203] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.564504] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e9de3df0-a5b4-4be3-a63b-4d4baf532bbc',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.566056] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.566243] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.566439] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.566552] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.566650] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.566809] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.566892] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.567053] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e9de3df0-a5b4-4be3-a63b-4d4baf532bbc',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.067346] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.067739] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.077926] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e9de3df0-a5b4-4be3-a63b-4d4baf532bbc',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.293839] env[65065]: INFO networking_nsxv3.common.synchronization [req-2b4a624e-c365-4604-8cad-83dd72889e9f req-bd12aa42-9872-4edb-9bde-fa97828ec6fc service nova] Enqueued Resource ID: e9de3df0-a5b4-4be3-a63b-4d4baf532bbc with Priority: HIGHEST for action security_group_rules [ 958.294056] env[65065]: INFO networking_nsxv3.common.synchronization [req-2b4a624e-c365-4604-8cad-83dd72889e9f req-bd12aa42-9872-4edb-9bde-fa97828ec6fc service nova] Enqueued Resource ID: e9de3df0-a5b4-4be3-a63b-4d4baf532bbc with Priority: HIGHEST for action security_group_members [ 958.294199] env[65065]: INFO networking_nsxv3.common.synchronization [req-2b4a624e-c365-4604-8cad-83dd72889e9f req-bd12aa42-9872-4edb-9bde-fa97828ec6fc service nova] Enqueued Resource ID: c4715e61-5115-4f6c-8795-883623e552c9 with Priority: HIGHEST for action port [ 958.294682] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9de3df0-a5b4-4be3-a63b-4d4baf532bbc with Priority: HIGHEST for action security_group_rules [ 958.294833] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9de3df0-a5b4-4be3-a63b-4d4baf532bbc with Priority: HIGHEST for action security_group_members [ 958.295278] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4715e61-5115-4f6c-8795-883623e552c9 with Priority: HIGHEST for action port [ 958.295594] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.295696] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.295906] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.296134] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.296238] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-c4715e61-5115-4f6c-8795-883623e552c9 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.296312] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c4715e61-5115-4f6c-8795-883623e552c9" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.296312] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c4715e61-5115-4f6c-8795-883623e552c9" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.296511] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c4715e61-5115-4f6c-8795-883623e552c9" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.296595] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c4715e61-5115-4f6c-8795-883623e552c9',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.584594] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e9de3df0-a5b4-4be3-a63b-4d4baf532bbc',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.798560] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c4715e61-5115-4f6c-8795-883623e552c9 with status ACTIVE [ 958.798744] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.798972] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.799118] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.799350] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.799446] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.799720] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.799830] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.799889] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.800136] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.800193] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.800335] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.800459] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.800493] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.800710] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.800749] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.800882] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c4715e61-5115-4f6c-8795-883623e552c9 is going to be updated. [ 958.827598] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.827869] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.827869] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.828103] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.830111] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.830111] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c4715e61-5115-4f6c-8795-883623e552c9" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.087028] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.087352] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.087352] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.087451] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.087563] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.087663] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e9de3df0-a5b4-4be3-a63b-4d4baf532bbc is going to be updated. [ 959.117463] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.117649] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.117689] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.117879] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.118140] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.128381] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9de3df0-a5b4-4be3-a63b-4d4baf532bbc in Status: IN_PROGRESS for 2s [ 960.217087] env[65065]: INFO networking_nsxv3.common.synchronization [None req-6240fd13-e103-480f-a4a0-d8e2b7e69f8e None None] Enqueued Resource ID: e288083c-613f-4b28-9e1f-edb3ef6978cd with Priority: HIGHEST for action port [ 960.217087] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e288083c-613f-4b28-9e1f-edb3ef6978cd with Priority: HIGHEST for action port [ 960.217460] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-e288083c-613f-4b28-9e1f-edb3ef6978cd taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.217460] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e288083c-613f-4b28-9e1f-edb3ef6978cd" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.217565] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e288083c-613f-4b28-9e1f-edb3ef6978cd" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.217846] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e288083c-613f-4b28-9e1f-edb3ef6978cd" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.218447] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e288083c-613f-4b28-9e1f-edb3ef6978cd',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.695899] env[65065]: INFO networking_nsxv3.common.synchronization [req-a08b1194-40a3-4879-929a-105a09e68a1a req-88043cfc-af2c-4c75-9f39-3fe9cb224440 tempest-ListServerFiltersTestJSON-2126051990 tempest-ListServerFiltersTestJSON-2126051990-project-member] Enqueued Resource ID: b36fec68-8054-450e-a4b6-c700b29fd114 with Priority: HIGHEST for action security_group_members [ 960.695899] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b36fec68-8054-450e-a4b6-c700b29fd114 with Priority: HIGHEST for action security_group_members [ 960.695899] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-b36fec68-8054-450e-a4b6-c700b29fd114 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.695899] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b36fec68-8054-450e-a4b6-c700b29fd114" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.695899] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b36fec68-8054-450e-a4b6-c700b29fd114" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.695899] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b36fec68-8054-450e-a4b6-c700b29fd114" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.695899] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.695899] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.695899] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.695899] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.695899] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.695899] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b36fec68-8054-450e-a4b6-c700b29fd114',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.720046] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e288083c-613f-4b28-9e1f-edb3ef6978cd [ 960.720293] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.720425] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.720495] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.720753] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.720844] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.720936] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e288083c-613f-4b28-9e1f-edb3ef6978cd already deleted. [ 960.721031] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e288083c-613f-4b28-9e1f-edb3ef6978cd" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.020654] env[65065]: INFO networking_nsxv3.common.synchronization [None req-45b1be69-4739-48a4-827e-f2578dcd1d9e tempest-ServerActionsTestOtherA-78922671 tempest-ServerActionsTestOtherA-78922671-project-member] Enqueued Resource ID: 6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e with Priority: HIGHEST for action security_group_rules [ 961.020654] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e with Priority: HIGHEST for action security_group_rules [ 961.021074] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.021569] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.021715] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.022097] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.022269] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.140414] env[65065]: INFO networking_nsxv3.common.synchronization [None req-1181bd2f-aef1-4f48-a00e-4a7897605d6b tempest-ServerActionsTestOtherA-78922671 tempest-ServerActionsTestOtherA-78922671-project-member] Enqueued Resource ID: 6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e with Priority: HIGHEST for action security_group_rules [ 961.140594] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9de3df0-a5b4-4be3-a63b-4d4baf532bbc in Status: SUCCESS [ 961.140794] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.144906] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e with Priority: HIGHEST for action security_group_rules [ 961.145128] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.145350] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.145553] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.145644] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.145709] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.145862] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.145946] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.146044] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.146425] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.146425] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.146425] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.146536] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.146631] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.146674] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.146705] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.146841] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.146958] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.147053] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.147142] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e9de3df0-a5b4-4be3-a63b-4d4baf532bbc',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.148071] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.148166] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.148270] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.148423] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.148554] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.149220] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.149220] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.149220] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.149220] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.149220] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e9de3df0-a5b4-4be3-a63b-4d4baf532bbc',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.180314] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.180464] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.180549] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.182478] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.182478] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.182478] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.182478] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.182478] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.182478] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.182478] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.182478] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b36fec68-8054-450e-a4b6-c700b29fd114 is going to be updated. [ 961.212377] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.212563] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.212622] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.212795] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.213147] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.227119] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b36fec68-8054-450e-a4b6-c700b29fd114 in Status: IN_PROGRESS for 2s [ 961.545204] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.545342] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.545400] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.545613] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.545702] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.545814] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e already deleted. [ 961.545900] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.546062] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.546430] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.546430] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.653408] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e9de3df0-a5b4-4be3-a63b-4d4baf532bbc: rpc.has_security_group_logging(os_id): False [ 961.654648] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e9de3df0-a5b4-4be3-a63b-4d4baf532bbc',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.674731] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.675274] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.675274] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.675274] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.675420] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.675493] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.675588] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.675641] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.675788] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.675861] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.676122] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.676207] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.676254] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.676488] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.676488] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.676636] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.676721] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.676781] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.676925] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.677010] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.677123] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e9de3df0-a5b4-4be3-a63b-4d4baf532bbc is going to be created. [ 961.753071] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.753211] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.753272] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.753487] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.753708] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.767229] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e9de3df0-a5b4-4be3-a63b-4d4baf532bbc in Status: IN_PROGRESS for 2s [ 962.067779] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.067935] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.068020] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.068257] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.068349] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.068456] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e already deleted. [ 962.068533] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.159421] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e9de3df0-a5b4-4be3-a63b-4d4baf532bbc',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.648389] env[65065]: INFO networking_nsxv3.common.synchronization [None req-3e5fe19c-8e11-4d64-9ca5-4916d78aef03 None None] Enqueued Resource ID: 7065ed81-6274-4402-83c0-d6b8926d50f0 with Priority: HIGHEST for action port [ 962.648964] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7065ed81-6274-4402-83c0-d6b8926d50f0 with Priority: HIGHEST for action port [ 962.649966] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-7065ed81-6274-4402-83c0-d6b8926d50f0 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.649966] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7065ed81-6274-4402-83c0-d6b8926d50f0" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.649966] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7065ed81-6274-4402-83c0-d6b8926d50f0" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.649966] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7065ed81-6274-4402-83c0-d6b8926d50f0" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.649966] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7065ed81-6274-4402-83c0-d6b8926d50f0',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.662234] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.662382] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.662455] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.662659] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.662751] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.662844] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e9de3df0-a5b4-4be3-a63b-4d4baf532bbc is going to be updated. [ 962.692744] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.694019] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.694019] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.694019] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.694019] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.704474] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9de3df0-a5b4-4be3-a63b-4d4baf532bbc in Status: IN_PROGRESS for 2s [ 963.152510] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7065ed81-6274-4402-83c0-d6b8926d50f0 [ 963.152510] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.152510] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.152705] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.152788] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.152875] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.152966] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7065ed81-6274-4402-83c0-d6b8926d50f0 already deleted. [ 963.153057] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7065ed81-6274-4402-83c0-d6b8926d50f0" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.239145] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b36fec68-8054-450e-a4b6-c700b29fd114 in Status: SUCCESS [ 963.239345] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b36fec68-8054-450e-a4b6-c700b29fd114 deletion is rescheduled due to dependency. [ 963.239458] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b36fec68-8054-450e-a4b6-c700b29fd114" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.780487] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e9de3df0-a5b4-4be3-a63b-4d4baf532bbc in Status: SUCCESS [ 963.780487] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.780940] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.780980] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.781100] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e9de3df0-a5b4-4be3-a63b-4d4baf532bbc',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.283751] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.283933] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.715583] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9de3df0-a5b4-4be3-a63b-4d4baf532bbc in Status: SUCCESS [ 964.715977] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.716191] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.716418] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.716617] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.716800] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.716800] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.716976] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.717050] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.717143] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.717234] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e9de3df0-a5b4-4be3-a63b-4d4baf532bbc',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.220032] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.220032] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.220032] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.220475] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.220475] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.220475] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.220595] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.220684] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.220775] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.220968] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.221142] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.221237] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.221299] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.221443] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.221581] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.221673] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.221734] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.221904] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.221973] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.222055] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.222200] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e9de3df0-a5b4-4be3-a63b-4d4baf532bbc',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.724470] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e9de3df0-a5b4-4be3-a63b-4d4baf532bbc: rpc.has_security_group_logging(os_id): False [ 965.745442] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.745731] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.745731] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.745935] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.746047] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.746245] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.746348] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.746407] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.746562] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.746639] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.746826] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.746918] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.746969] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.747129] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.747203] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.747403] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.747590] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.747654] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.747804] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.747879] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.747962] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e9de3df0-a5b4-4be3-a63b-4d4baf532bbc is going to be updated. [ 965.814762] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.814951] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.814995] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.815295] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.815455] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.829203] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e9de3df0-a5b4-4be3-a63b-4d4baf532bbc in Status: IN_PROGRESS for 2s [ 967.649423] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 967.649802] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 967.843323] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e9de3df0-a5b4-4be3-a63b-4d4baf532bbc in Status: SUCCESS [ 967.843515] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.843717] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.843952] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.844085] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e9de3df0-a5b4-4be3-a63b-4d4baf532bbc',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.348936] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.349199] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.349275] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.349489] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.349680] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.349781] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.349843] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.349986] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.350083] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.350180] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.350260] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e9de3df0-a5b4-4be3-a63b-4d4baf532bbc',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.852495] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.852836] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.852836] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.853106] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.853276] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.853377] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.853442] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.853601] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.853686] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.853773] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.853934] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.854052] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.854116] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.854279] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.854417] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.854521] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.854580] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.854717] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.854807] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.854904] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.854986] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e9de3df0-a5b4-4be3-a63b-4d4baf532bbc',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.357179] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e9de3df0-a5b4-4be3-a63b-4d4baf532bbc: rpc.has_security_group_logging(os_id): False [ 969.378258] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.378451] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.378511] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.378752] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.378894] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.379098] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.379222] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.379296] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.379496] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.379590] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.379943] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.380071] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.380140] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.380299] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.380380] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.380659] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.380842] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.380928] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.381281] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.381409] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.381513] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e9de3df0-a5b4-4be3-a63b-4d4baf532bbc is going to be updated. [ 969.442218] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.442436] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.442509] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.442719] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.442865] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.455131] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e9de3df0-a5b4-4be3-a63b-4d4baf532bbc in Status: IN_PROGRESS for 2s [ 970.624010] env[65065]: INFO networking_nsxv3.common.synchronization [req-685dd5f0-ee12-437c-b4c8-1bdc46baec42 req-c0234db8-0b20-49af-8532-a9fb284e17de tempest-ServersTestMultiNic-1110836678 tempest-ServersTestMultiNic-1110836678-project-member] Enqueued Resource ID: e9de3df0-a5b4-4be3-a63b-4d4baf532bbc with Priority: HIGHEST for action security_group_members [ 970.624536] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9de3df0-a5b4-4be3-a63b-4d4baf532bbc with Priority: HIGHEST for action security_group_members [ 970.624836] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.624957] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.625469] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.625469] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.625552] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.625662] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.625717] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.625853] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.625938] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.626041] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e9de3df0-a5b4-4be3-a63b-4d4baf532bbc',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.862542] env[65065]: INFO networking_nsxv3.common.synchronization [req-685dd5f0-ee12-437c-b4c8-1bdc46baec42 req-2b1592e7-bb05-4b6f-8c7a-305ac91b1ce7 tempest-ServersTestMultiNic-1110836678 tempest-ServersTestMultiNic-1110836678-project-member] Enqueued Resource ID: e9de3df0-a5b4-4be3-a63b-4d4baf532bbc with Priority: HIGHEST for action security_group_members [ 970.863579] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9de3df0-a5b4-4be3-a63b-4d4baf532bbc with Priority: HIGHEST for action security_group_members [ 970.863579] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.863579] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.043579] env[65065]: INFO networking_nsxv3.common.synchronization [req-685dd5f0-ee12-437c-b4c8-1bdc46baec42 req-cdd1d9a2-1241-4f1d-9cf0-5243e92eb287 tempest-ServersTestMultiNic-1110836678 tempest-ServersTestMultiNic-1110836678-project-member] Enqueued Resource ID: e9de3df0-a5b4-4be3-a63b-4d4baf532bbc with Priority: HIGHEST for action security_group_members [ 971.044112] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9de3df0-a5b4-4be3-a63b-4d4baf532bbc with Priority: HIGHEST for action security_group_members [ 971.044747] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.044747] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.128258] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e9de3df0-a5b4-4be3-a63b-4d4baf532bbc',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.469970] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e9de3df0-a5b4-4be3-a63b-4d4baf532bbc in Status: SUCCESS [ 971.470222] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.528896] env[65065]: INFO networking_nsxv3.common.synchronization [req-78cfe916-8f36-464a-9e43-3e1e860a53af req-03eee639-e4a5-45ab-a030-05b6c1d774a8 tempest-DeleteServersTestJSON-1316666736 tempest-DeleteServersTestJSON-1316666736-project-member] Enqueued Resource ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 with Priority: HIGHEST for action security_group_members [ 971.529490] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 with Priority: HIGHEST for action security_group_members [ 971.529945] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d0941d4-57d8-45e9-9f2f-95128b8136e5 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.530140] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.530241] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.530514] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.530748] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.530924] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.531039] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.531286] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.531415] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.531555] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d0941d4-57d8-45e9-9f2f-95128b8136e5',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.631016] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e9de3df0-a5b4-4be3-a63b-4d4baf532bbc',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.033690] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.034131] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.034131] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.034251] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.034251] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.034533] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.034664] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.034752] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.034934] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.035048] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.035162] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 is going to be updated. [ 972.063061] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.063244] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.063244] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.063537] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.063720] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.074931] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 in Status: IN_PROGRESS for 2s [ 972.134308] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.134308] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.134308] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.134308] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.134308] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.134308] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e9de3df0-a5b4-4be3-a63b-4d4baf532bbc is going to be updated. [ 972.163346] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.163524] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.163579] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.163759] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.163894] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.172388] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9de3df0-a5b4-4be3-a63b-4d4baf532bbc in Status: IN_PROGRESS for 2s [ 974.086079] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 in Status: SUCCESS [ 974.086360] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 deletion is rescheduled due to dependency. [ 974.086403] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.182645] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9de3df0-a5b4-4be3-a63b-4d4baf532bbc in Status: SUCCESS [ 974.182645] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.182906] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.183110] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.183300] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.183412] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.183468] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.183624] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.183707] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.183805] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e9de3df0-a5b4-4be3-a63b-4d4baf532bbc',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.685898] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.686103] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.686178] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.686393] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.686486] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.686713] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.686821] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.686909] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.687114] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.687198] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.687319] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e9de3df0-a5b4-4be3-a63b-4d4baf532bbc is going to be updated. [ 974.713832] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.713987] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.714069] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.714276] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.714419] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.724028] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9de3df0-a5b4-4be3-a63b-4d4baf532bbc in Status: IN_PROGRESS for 2s [ 975.246646] env[65065]: INFO networking_nsxv3.common.synchronization [req-c9f40acb-6ae8-4a24-a8b9-a4941f959603 req-d2edd570-f871-496f-b942-6f4d06ff4942 tempest-MultipleCreateTestJSON-605630201 tempest-MultipleCreateTestJSON-605630201-project-member] Enqueued Resource ID: d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f with Priority: HIGHEST for action security_group_members [ 975.248580] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f with Priority: HIGHEST for action security_group_members [ 975.248948] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.249159] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.249228] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.249438] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.249940] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.250055] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.250123] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.250286] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.250372] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.250468] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.753863] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.754038] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.754318] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.754391] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.754468] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.754670] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.754770] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.754830] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.754978] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.755065] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.755150] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f is going to be updated. [ 975.781032] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.781213] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.781213] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.782418] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.782418] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.795025] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f in Status: IN_PROGRESS for 2s [ 976.018491] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock network-533 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.018683] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "network-533" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.018806] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "network-533" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.019095] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "network-533" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.019348] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.019499] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.019613] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.019909] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.020066] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.020271] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 976.020381] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 976.020490] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 976.020653] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 976.020798] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 976.020905] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 976.021080] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 976.042446] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 976.042446] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 976.042446] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 976.042635] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "network-533" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.043027] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock port-94fb0b7d-5af8-424c-95dc-b868ca232c49 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.043248] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "port-94fb0b7d-5af8-424c-95dc-b868ca232c49" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.043398] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "port-94fb0b7d-5af8-424c-95dc-b868ca232c49" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.043736] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "port-94fb0b7d-5af8-424c-95dc-b868ca232c49" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.043908] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('94fb0b7d-5af8-424c-95dc-b868ca232c49',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.546129] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.546579] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.546579] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.547057] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.547057] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.547057] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Segment Port 94fb0b7d-5af8-424c-95dc-b868ca232c49 not found, creating... [ 976.547303] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.547444] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.547606] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.547801] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.547980] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.548323] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.548495] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.548564] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.548738] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.548907] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.549065] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Resource: SegmentPort with ID: 94fb0b7d-5af8-424c-95dc-b868ca232c49 is going to be created. [ 976.569388] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.569603] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.569807] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.570113] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.570616] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.570616] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "port-94fb0b7d-5af8-424c-95dc-b868ca232c49" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.735169] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9de3df0-a5b4-4be3-a63b-4d4baf532bbc in Status: SUCCESS [ 976.735353] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e9de3df0-a5b4-4be3-a63b-4d4baf532bbc deletion is rescheduled due to dependency. [ 976.735526] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.735698] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.735929] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.736132] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.736248] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.736314] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.736470] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.736553] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.736650] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e9de3df0-a5b4-4be3-a63b-4d4baf532bbc',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.239092] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.239305] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.239305] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.239580] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.239734] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.239913] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.240030] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.240091] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.240248] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.240323] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.240411] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e9de3df0-a5b4-4be3-a63b-4d4baf532bbc is going to be updated. [ 977.248202] env[65065]: INFO networking_nsxv3.common.synchronization [req-c9f40acb-6ae8-4a24-a8b9-a4941f959603 req-49e0d999-1bee-4ba8-9ac9-21c2642c92df service nova] Enqueued Resource ID: d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f with Priority: HIGHEST for action security_group_rules [ 977.248429] env[65065]: INFO networking_nsxv3.common.synchronization [req-c9f40acb-6ae8-4a24-a8b9-a4941f959603 req-49e0d999-1bee-4ba8-9ac9-21c2642c92df service nova] Enqueued Resource ID: d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f with Priority: HIGHEST for action security_group_members [ 977.248636] env[65065]: INFO networking_nsxv3.common.synchronization [req-c9f40acb-6ae8-4a24-a8b9-a4941f959603 req-49e0d999-1bee-4ba8-9ac9-21c2642c92df service nova] Enqueued Resource ID: 94fb0b7d-5af8-424c-95dc-b868ca232c49 with Priority: HIGHEST for action port [ 977.250075] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f with Priority: HIGHEST for action security_group_rules [ 977.250173] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f with Priority: HIGHEST for action security_group_members [ 977.250214] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94fb0b7d-5af8-424c-95dc-b868ca232c49 with Priority: HIGHEST for action port [ 977.250466] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.250578] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.250647] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.250833] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.250918] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.251798] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.251921] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.252096] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-94fb0b7d-5af8-424c-95dc-b868ca232c49 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.252192] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-94fb0b7d-5af8-424c-95dc-b868ca232c49" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.252256] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-94fb0b7d-5af8-424c-95dc-b868ca232c49" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.252414] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-94fb0b7d-5af8-424c-95dc-b868ca232c49" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.252521] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('94fb0b7d-5af8-424c-95dc-b868ca232c49',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.269144] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.269328] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.269407] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.269702] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.269975] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.278640] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9de3df0-a5b4-4be3-a63b-4d4baf532bbc in Status: IN_PROGRESS for 2s [ 977.606828] env[65065]: INFO networking_nsxv3.common.synchronization [req-c9f40acb-6ae8-4a24-a8b9-a4941f959603 req-d3c21e11-db37-49ac-984b-c9e2be0fafb5 tempest-MultipleCreateTestJSON-605630201 tempest-MultipleCreateTestJSON-605630201-project-member] Enqueued Resource ID: d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f with Priority: HIGHEST for action security_group_members [ 977.607462] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f with Priority: HIGHEST for action security_group_members [ 977.607825] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.607955] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.754214] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.754408] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.754540] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 94fb0b7d-5af8-424c-95dc-b868ca232c49 with status ACTIVE [ 977.754709] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.754830] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.754893] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.755145] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.755223] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.755361] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.755457] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.755511] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.755667] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.755814] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.755981] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.756141] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.756141] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.756372] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.756372] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.756538] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 94fb0b7d-5af8-424c-95dc-b868ca232c49 is going to be updated. [ 977.778524] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.778524] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.778524] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.778524] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.778524] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.778524] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-94fb0b7d-5af8-424c-95dc-b868ca232c49" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.802606] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f in Status: IN_PROGRESS for 4s [ 977.909888] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock network-533 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.910112] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "network-533" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.910238] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "network-533" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.910690] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "network-533" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.910805] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.910919] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.911080] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.911350] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.911422] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.911600] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 977.911725] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 977.911832] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 977.912045] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 977.912111] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 977.912235] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 977.912375] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 977.941767] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 977.941767] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 977.941767] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 977.941767] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "network-533" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.942077] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock port-589a6ce8-71fa-466e-8287-92d3518fbb83 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.942915] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "port-589a6ce8-71fa-466e-8287-92d3518fbb83" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.942915] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "port-589a6ce8-71fa-466e-8287-92d3518fbb83" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.942915] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "port-589a6ce8-71fa-466e-8287-92d3518fbb83" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.942915] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('589a6ce8-71fa-466e-8287-92d3518fbb83',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.445228] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.445452] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.445579] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.445853] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.446026] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.446697] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Segment Port 589a6ce8-71fa-466e-8287-92d3518fbb83 not found, creating... [ 978.447302] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.447584] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.447807] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.448526] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.448787] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.449265] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.449698] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.449790] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.450145] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.450389] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.450694] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Resource: SegmentPort with ID: 589a6ce8-71fa-466e-8287-92d3518fbb83 is going to be created. [ 978.474147] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.474386] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.474512] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.474789] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.475121] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.475350] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "port-589a6ce8-71fa-466e-8287-92d3518fbb83" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.224359] env[65065]: INFO networking_nsxv3.common.synchronization [req-c9f40acb-6ae8-4a24-a8b9-a4941f959603 req-95fcf837-1def-46a0-bae5-a1f3bfd89ae6 service nova] Enqueued Resource ID: d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f with Priority: HIGHEST for action security_group_rules [ 979.224359] env[65065]: INFO networking_nsxv3.common.synchronization [req-c9f40acb-6ae8-4a24-a8b9-a4941f959603 req-95fcf837-1def-46a0-bae5-a1f3bfd89ae6 service nova] Enqueued Resource ID: d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f with Priority: HIGHEST for action security_group_members [ 979.224359] env[65065]: INFO networking_nsxv3.common.synchronization [req-c9f40acb-6ae8-4a24-a8b9-a4941f959603 req-95fcf837-1def-46a0-bae5-a1f3bfd89ae6 service nova] Enqueued Resource ID: 589a6ce8-71fa-466e-8287-92d3518fbb83 with Priority: HIGHEST for action port [ 979.224801] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f with Priority: HIGHEST for action security_group_rules [ 979.224801] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f with Priority: HIGHEST for action security_group_members [ 979.224801] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 589a6ce8-71fa-466e-8287-92d3518fbb83 with Priority: HIGHEST for action port [ 979.225157] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.225157] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.225322] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.225408] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.225543] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-589a6ce8-71fa-466e-8287-92d3518fbb83 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.225645] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-589a6ce8-71fa-466e-8287-92d3518fbb83" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.225709] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-589a6ce8-71fa-466e-8287-92d3518fbb83" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.225900] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-589a6ce8-71fa-466e-8287-92d3518fbb83" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.225977] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('589a6ce8-71fa-466e-8287-92d3518fbb83',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.288730] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9de3df0-a5b4-4be3-a63b-4d4baf532bbc in Status: SUCCESS [ 979.288967] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e9de3df0-a5b4-4be3-a63b-4d4baf532bbc deletion is rescheduled due to dependency. [ 979.289130] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.728083] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 589a6ce8-71fa-466e-8287-92d3518fbb83 with status ACTIVE [ 979.728313] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.728461] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.728532] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.728780] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.728928] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.729163] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.729271] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.729338] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.729509] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.729578] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.729798] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.729894] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.729958] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.730120] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.730196] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.730281] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 589a6ce8-71fa-466e-8287-92d3518fbb83 is going to be updated. [ 979.751190] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.751350] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.751394] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.751603] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.751749] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.751910] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-589a6ce8-71fa-466e-8287-92d3518fbb83" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.815927] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f in Status: SUCCESS [ 979.816196] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f deletion is rescheduled due to dependency. [ 979.816313] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.816495] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.816706] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.816888] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.817048] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.817114] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.817270] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.817353] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.817491] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.992121] env[65065]: INFO networking_nsxv3.common.synchronization [req-7c0c8c71-5e4e-492e-92b8-f08f165122df req-048a8c49-5e1f-4645-af35-62641aab9fe2 tempest-ServerActionsTestOtherA-78922671 tempest-ServerActionsTestOtherA-78922671-project-member] Enqueued Resource ID: 6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e with Priority: HIGHEST for action security_group_members [ 979.992671] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e with Priority: HIGHEST for action security_group_members [ 979.993146] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.993256] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.993256] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.993518] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.993618] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.993809] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.993809] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.993904] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.994050] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.994134] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.320434] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.350940] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock network-33 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.351156] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "network-33" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.351280] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "network-33" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.351608] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "network-33" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.351866] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.352035] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.352151] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.352364] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.352509] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.352706] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 980.352816] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 980.352980] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 980.353046] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 980.353131] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 980.353231] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 980.353360] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 980.374220] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 980.374445] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 980.374693] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 980.374928] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "network-33" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.375556] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock port-944da6ae-57bf-4d4a-83e0-521c1bbab69a taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.375795] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "port-944da6ae-57bf-4d4a-83e0-521c1bbab69a" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.375940] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "port-944da6ae-57bf-4d4a-83e0-521c1bbab69a" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.376480] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "port-944da6ae-57bf-4d4a-83e0-521c1bbab69a" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.376674] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('944da6ae-57bf-4d4a-83e0-521c1bbab69a',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.496834] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.497010] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.497160] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.497388] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.497477] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.497747] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.497855] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.497911] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.498076] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.498151] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.498255] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e already deleted. [ 980.498380] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.823082] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.879308] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.879546] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.879761] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.880077] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.880265] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.880441] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Segment Port 944da6ae-57bf-4d4a-83e0-521c1bbab69a not found, creating... [ 980.880739] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.880977] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.881064] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.881304] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.881461] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.881767] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.882013] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.882264] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.882563] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.882717] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.882866] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Resource: SegmentPort with ID: 944da6ae-57bf-4d4a-83e0-521c1bbab69a is going to be created. [ 980.920664] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.920987] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.921086] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.921351] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.921580] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.921792] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "port-944da6ae-57bf-4d4a-83e0-521c1bbab69a" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.326709] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.327091] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.327091] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.327324] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.327455] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.327581] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f is going to be updated. [ 981.371237] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.371237] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.371237] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.371237] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.371237] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.382695] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f in Status: IN_PROGRESS for 2s [ 981.738872] env[65065]: INFO networking_nsxv3.common.synchronization [req-7c0c8c71-5e4e-492e-92b8-f08f165122df req-f283d36c-73d0-43d1-b147-581cb46263ac service nova] Enqueued Resource ID: 6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e with Priority: HIGHEST for action security_group_rules [ 981.738950] env[65065]: INFO networking_nsxv3.common.synchronization [req-7c0c8c71-5e4e-492e-92b8-f08f165122df req-f283d36c-73d0-43d1-b147-581cb46263ac service nova] Enqueued Resource ID: 6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e with Priority: HIGHEST for action security_group_members [ 981.739444] env[65065]: INFO networking_nsxv3.common.synchronization [req-7c0c8c71-5e4e-492e-92b8-f08f165122df req-f283d36c-73d0-43d1-b147-581cb46263ac service nova] Enqueued Resource ID: 944da6ae-57bf-4d4a-83e0-521c1bbab69a with Priority: HIGHEST for action port [ 981.739797] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e with Priority: HIGHEST for action security_group_rules [ 981.739935] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e with Priority: HIGHEST for action security_group_members [ 981.740041] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 944da6ae-57bf-4d4a-83e0-521c1bbab69a with Priority: HIGHEST for action port [ 981.740323] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.740441] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.740508] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.740727] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.740819] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.741833] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.741833] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.742074] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.742133] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.742270] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.742363] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.742423] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.742564] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.742646] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.742747] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.744046] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-944da6ae-57bf-4d4a-83e0-521c1bbab69a taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.744046] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-944da6ae-57bf-4d4a-83e0-521c1bbab69a" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.744046] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-944da6ae-57bf-4d4a-83e0-521c1bbab69a" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.744046] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-944da6ae-57bf-4d4a-83e0-521c1bbab69a" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.744046] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('944da6ae-57bf-4d4a-83e0-521c1bbab69a',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.245469] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.246541] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.247335] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.248052] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 944da6ae-57bf-4d4a-83e0-521c1bbab69a with status ACTIVE [ 982.248052] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.248252] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.248252] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.248473] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.248973] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.248973] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.248973] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.249587] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.249587] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.249587] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.249587] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.249912] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.249912] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.249912] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.250078] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.250078] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 944da6ae-57bf-4d4a-83e0-521c1bbab69a is going to be updated. [ 982.277172] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.277357] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.277419] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.277622] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.277795] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.277960] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-944da6ae-57bf-4d4a-83e0-521c1bbab69a" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.748375] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.940707] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock network-887 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.941052] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "network-887" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.941219] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "network-887" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.941555] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "network-887" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.941885] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.942169] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.942302] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.942537] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.942828] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.943106] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 982.943269] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 982.943458] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 982.943674] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 982.943859] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 982.944020] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 982.944192] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 982.965683] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 982.965941] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 982.966191] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 982.966472] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "network-887" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.966945] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock port-fb4e7136-3a92-4b72-a37a-3c826da7fbd9 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.967256] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "port-fb4e7136-3a92-4b72-a37a-3c826da7fbd9" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.970259] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "port-fb4e7136-3a92-4b72-a37a-3c826da7fbd9" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.973255] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "port-fb4e7136-3a92-4b72-a37a-3c826da7fbd9" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.973255] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb4e7136-3a92-4b72-a37a-3c826da7fbd9',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.254780] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.254978] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.254978] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.255208] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.255298] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.255403] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e is going to be created. [ 983.279456] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.279697] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.279697] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.279920] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.280091] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.292763] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e in Status: UNINITIALIZED for 2s [ 983.393047] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f in Status: SUCCESS [ 983.393289] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.393461] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.393715] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.393981] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.394115] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.394180] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.394337] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.394444] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.394585] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.475595] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.475826] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.475951] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.476254] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.476408] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.476693] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.476850] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.476970] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.477207] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.477337] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.477630] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.477818] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.477940] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.478200] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.478331] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.478471] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Resource: SegmentPort with ID: fb4e7136-3a92-4b72-a37a-3c826da7fbd9 is going to be updated. [ 983.500700] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.500827] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.500922] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.501607] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.501607] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.501700] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "port-fb4e7136-3a92-4b72-a37a-3c826da7fbd9" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.896914] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.197599] env[65065]: INFO networking_nsxv3.common.synchronization [req-919a2686-ec5e-4604-b050-c093394f990d req-9926a489-8e6a-440e-9ab7-18662d1bcedb service nova] Enqueued Resource ID: a793cfdd-5070-4bec-85b3-ff10a26c966f with Priority: HIGHEST for action security_group_rules [ 984.197763] env[65065]: INFO networking_nsxv3.common.synchronization [req-919a2686-ec5e-4604-b050-c093394f990d req-9926a489-8e6a-440e-9ab7-18662d1bcedb service nova] Enqueued Resource ID: a793cfdd-5070-4bec-85b3-ff10a26c966f with Priority: HIGHEST for action security_group_members [ 984.198531] env[65065]: INFO networking_nsxv3.common.synchronization [req-919a2686-ec5e-4604-b050-c093394f990d req-9926a489-8e6a-440e-9ab7-18662d1bcedb service nova] Enqueued Resource ID: fb4e7136-3a92-4b72-a37a-3c826da7fbd9 with Priority: HIGHEST for action port [ 984.199124] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a793cfdd-5070-4bec-85b3-ff10a26c966f with Priority: HIGHEST for action security_group_rules [ 984.199321] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a793cfdd-5070-4bec-85b3-ff10a26c966f with Priority: HIGHEST for action security_group_members [ 984.199449] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb4e7136-3a92-4b72-a37a-3c826da7fbd9 with Priority: HIGHEST for action port [ 984.199804] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a793cfdd-5070-4bec-85b3-ff10a26c966f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.199960] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a793cfdd-5070-4bec-85b3-ff10a26c966f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.200061] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a793cfdd-5070-4bec-85b3-ff10a26c966f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.200282] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a793cfdd-5070-4bec-85b3-ff10a26c966f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.200386] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a793cfdd-5070-4bec-85b3-ff10a26c966f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.201261] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-a793cfdd-5070-4bec-85b3-ff10a26c966f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.201409] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a793cfdd-5070-4bec-85b3-ff10a26c966f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.201511] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a793cfdd-5070-4bec-85b3-ff10a26c966f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.201683] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a793cfdd-5070-4bec-85b3-ff10a26c966f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.201884] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.202558] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.202558] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.202558] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.202558] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.202558] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a793cfdd-5070-4bec-85b3-ff10a26c966f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.203299] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-fb4e7136-3a92-4b72-a37a-3c826da7fbd9 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.203440] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fb4e7136-3a92-4b72-a37a-3c826da7fbd9" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.203521] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fb4e7136-3a92-4b72-a37a-3c826da7fbd9" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.203685] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fb4e7136-3a92-4b72-a37a-3c826da7fbd9" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.203921] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb4e7136-3a92-4b72-a37a-3c826da7fbd9',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.398497] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.704950] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a793cfdd-5070-4bec-85b3-ff10a26c966f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.705973] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-a793cfdd-5070-4bec-85b3-ff10a26c966f taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.706104] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a793cfdd-5070-4bec-85b3-ff10a26c966f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.706451] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fb4e7136-3a92-4b72-a37a-3c826da7fbd9 with status ACTIVE [ 984.706611] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.707032] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.707032] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.707032] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.707179] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.707213] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.707340] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.707608] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.707608] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.707608] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.707910] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.707910] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.707910] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.708046] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.708080] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.708762] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fb4e7136-3a92-4b72-a37a-3c826da7fbd9 is going to be updated. [ 984.728745] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.728956] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.729064] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.729205] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.729336] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.729483] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fb4e7136-3a92-4b72-a37a-3c826da7fbd9" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.901370] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.901767] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.901767] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.901901] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.901957] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.902091] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f is going to be updated. [ 984.936248] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.936248] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.936248] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.936248] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.936248] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.948170] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f in Status: IN_PROGRESS for 2s [ 985.207328] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a793cfdd-5070-4bec-85b3-ff10a26c966f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.304807] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e in Status: SUCCESS [ 985.305152] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.305359] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.305669] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.305919] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.306089] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.306195] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.306390] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.306526] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.306672] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.306812] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.709612] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.709838] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.709882] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.710107] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.710191] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.710296] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a793cfdd-5070-4bec-85b3-ff10a26c966f is going to be updated. [ 985.741989] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.742217] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.742390] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.742525] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.742671] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.751706] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a793cfdd-5070-4bec-85b3-ff10a26c966f in Status: IN_PROGRESS for 2s [ 985.809822] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.311525] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e: rpc.has_security_group_logging(os_id): False [ 986.336436] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.336649] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.336649] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.337029] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.337166] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.337566] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.337718] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.337793] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.338151] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.338248] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.338345] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e is going to be created. [ 986.419429] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.419637] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.419637] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.419924] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.420133] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.437902] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e in Status: IN_PROGRESS for 2s [ 986.958205] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f in Status: SUCCESS [ 986.958473] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.958666] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.958929] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.959169] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.959321] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.959395] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.959587] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.959681] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.959784] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.959890] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.960851] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.961056] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.961211] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.961908] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.961908] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.961908] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.961908] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.961908] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.463910] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.464269] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.464317] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.768071] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a793cfdd-5070-4bec-85b3-ff10a26c966f in Status: SUCCESS [ 987.769196] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a793cfdd-5070-4bec-85b3-ff10a26c966f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.769196] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a793cfdd-5070-4bec-85b3-ff10a26c966f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.769196] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a793cfdd-5070-4bec-85b3-ff10a26c966f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.769196] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.769196] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.769196] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.769196] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.769569] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.769569] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a793cfdd-5070-4bec-85b3-ff10a26c966f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.769569] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a793cfdd-5070-4bec-85b3-ff10a26c966f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.968259] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.272581] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-a793cfdd-5070-4bec-85b3-ff10a26c966f taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.272957] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a793cfdd-5070-4bec-85b3-ff10a26c966f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.273103] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a793cfdd-5070-4bec-85b3-ff10a26c966f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.273368] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a793cfdd-5070-4bec-85b3-ff10a26c966f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.273585] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.273876] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.274039] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.274244] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.274337] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.274434] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a793cfdd-5070-4bec-85b3-ff10a26c966f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.274684] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-a793cfdd-5070-4bec-85b3-ff10a26c966f taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.274759] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a793cfdd-5070-4bec-85b3-ff10a26c966f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.274759] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a793cfdd-5070-4bec-85b3-ff10a26c966f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.274912] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a793cfdd-5070-4bec-85b3-ff10a26c966f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.275079] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.275201] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.275236] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.275398] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.275434] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.275504] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a793cfdd-5070-4bec-85b3-ff10a26c966f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.275595] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a793cfdd-5070-4bec-85b3-ff10a26c966f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.451777] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e in Status: SUCCESS [ 988.452069] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.471044] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.471044] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.471511] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.471511] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.471511] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.471511] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f is going to be updated. [ 988.504589] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.504776] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.504826] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.505035] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.505182] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.514281] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f in Status: IN_PROGRESS for 2s [ 988.778013] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a793cfdd-5070-4bec-85b3-ff10a26c966f: rpc.has_security_group_logging(os_id): False [ 988.805441] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.805666] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.805666] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.805855] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.805943] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.806261] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.806261] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.806383] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.806470] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.806543] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.806718] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.806851] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.806950] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.807203] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.807281] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.807465] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.807557] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.807673] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.807824] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.807906] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.807995] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a793cfdd-5070-4bec-85b3-ff10a26c966f is going to be updated. [ 988.885474] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.885616] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.885689] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.886899] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.886899] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.903902] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a793cfdd-5070-4bec-85b3-ff10a26c966f in Status: IN_PROGRESS for 2s [ 989.200368] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 989.200598] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=4 [ 989.830593] env[65065]: INFO networking_nsxv3.common.synchronization [req-2e6e3e2e-5060-486b-96cd-d03c01ab9721 req-02f11ca4-dc15-4631-a0f4-712d485d7f0b tempest-ServersTestJSON-1126920631 tempest-ServersTestJSON-1126920631-project-member] Enqueued Resource ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 with Priority: HIGHEST for action security_group_members [ 989.832165] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 with Priority: HIGHEST for action security_group_members [ 989.832678] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e5f0086-b1e3-4f00-8207-8306f153d0e4 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.832889] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.833050] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.833398] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.833709] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.833930] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.834557] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.834557] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.834557] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.835021] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e5f0086-b1e3-4f00-8207-8306f153d0e4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.256867] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock network-381 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.257097] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "network-381" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.257227] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "network-381" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.257480] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "network-381" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.258665] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.258665] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.258773] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.259025] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.259248] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.259510] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 990.259677] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 990.259881] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 990.260054] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 990.260219] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 990.260371] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 990.260548] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 990.281806] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 990.281989] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 990.282394] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 990.282637] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "network-381" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.283113] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock port-f0b7a9ee-c7eb-4fed-8202-3e66f51ebc34 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.283390] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "port-f0b7a9ee-c7eb-4fed-8202-3e66f51ebc34" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.283607] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "port-f0b7a9ee-c7eb-4fed-8202-3e66f51ebc34" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.284082] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "port-f0b7a9ee-c7eb-4fed-8202-3e66f51ebc34" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.284302] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f0b7a9ee-c7eb-4fed-8202-3e66f51ebc34',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.338392] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1e5f0086-b1e3-4f00-8207-8306f153d0e4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.525877] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f in Status: SUCCESS [ 990.526091] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.526263] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.526490] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.526680] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.526905] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.526905] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.527032] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.527117] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.527213] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.527385] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.527489] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.527557] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.527721] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.527875] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.527970] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.528050] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.528208] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.528275] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.528355] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.528447] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.788068] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.788329] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.788467] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.788752] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.788928] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.789126] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Segment Port f0b7a9ee-c7eb-4fed-8202-3e66f51ebc34 not found, creating... [ 990.789404] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.789562] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.789675] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.789970] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.790126] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.790418] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.790600] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.790692] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.790916] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.791065] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.791206] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Resource: SegmentPort with ID: f0b7a9ee-c7eb-4fed-8202-3e66f51ebc34 is going to be created. [ 990.816249] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.816534] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.816667] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.816972] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.817293] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.817561] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "port-f0b7a9ee-c7eb-4fed-8202-3e66f51ebc34" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.841380] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1e5f0086-b1e3-4f00-8207-8306f153d0e4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.932417] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a793cfdd-5070-4bec-85b3-ff10a26c966f in Status: SUCCESS [ 990.932671] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a793cfdd-5070-4bec-85b3-ff10a26c966f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.031263] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f: rpc.has_security_group_logging(os_id): False [ 991.057301] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.057572] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.057572] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.057775] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.057890] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.058163] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.058273] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.058324] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.058498] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.058576] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.058771] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.058897] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.058974] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.059325] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.059405] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.059633] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.059773] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.059910] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.059985] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.060095] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.060227] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f is going to be updated. [ 991.131134] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.131358] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.131406] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.131662] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.131819] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.149996] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f in Status: IN_PROGRESS for 2s [ 991.346630] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.346630] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.346630] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.346630] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.346630] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.346630] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 is going to be updated. [ 991.387648] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.387949] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.387949] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.388113] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.388243] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.400896] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 in Status: IN_PROGRESS for 2s [ 991.592836] env[65065]: INFO networking_nsxv3.common.synchronization [req-2e6e3e2e-5060-486b-96cd-d03c01ab9721 req-a5fa72d3-f326-40be-9157-f8786f2e8ac9 service nova] Enqueued Resource ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 with Priority: HIGHEST for action security_group_rules [ 991.593744] env[65065]: INFO networking_nsxv3.common.synchronization [req-2e6e3e2e-5060-486b-96cd-d03c01ab9721 req-a5fa72d3-f326-40be-9157-f8786f2e8ac9 service nova] Enqueued Resource ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 with Priority: HIGHEST for action security_group_members [ 991.593744] env[65065]: INFO networking_nsxv3.common.synchronization [req-2e6e3e2e-5060-486b-96cd-d03c01ab9721 req-a5fa72d3-f326-40be-9157-f8786f2e8ac9 service nova] Enqueued Resource ID: f0b7a9ee-c7eb-4fed-8202-3e66f51ebc34 with Priority: HIGHEST for action port [ 991.593966] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 with Priority: HIGHEST for action security_group_rules [ 991.594091] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 with Priority: HIGHEST for action security_group_members [ 991.594199] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0b7a9ee-c7eb-4fed-8202-3e66f51ebc34 with Priority: HIGHEST for action port [ 991.596376] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1e5f0086-b1e3-4f00-8207-8306f153d0e4 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.596533] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.596581] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.596841] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.596959] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1e5f0086-b1e3-4f00-8207-8306f153d0e4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.597901] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e5f0086-b1e3-4f00-8207-8306f153d0e4 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.598124] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.598786] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-f0b7a9ee-c7eb-4fed-8202-3e66f51ebc34 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.598786] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f0b7a9ee-c7eb-4fed-8202-3e66f51ebc34" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.598786] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f0b7a9ee-c7eb-4fed-8202-3e66f51ebc34" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.598786] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f0b7a9ee-c7eb-4fed-8202-3e66f51ebc34" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.599013] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f0b7a9ee-c7eb-4fed-8202-3e66f51ebc34',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.831103] env[65065]: INFO networking_nsxv3.common.synchronization [req-cf81bcce-25a1-4301-97f6-470e069615fa req-191fa4d1-0676-4d94-8988-c0537c3fcaf5 tempest-MultipleCreateTestJSON-605630201 tempest-MultipleCreateTestJSON-605630201-project-member] Enqueued Resource ID: d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f with Priority: HIGHEST for action security_group_members [ 991.831746] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f with Priority: HIGHEST for action security_group_members [ 991.832097] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.832228] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.832295] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.832839] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.832999] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.833183] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.833238] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.833415] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.833493] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.833563] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.959100] env[65065]: INFO networking_nsxv3.common.synchronization [req-f4774509-37c0-4370-aa71-3ce94dbe80d7 req-42c68cb6-d233-4658-ac88-3f86150d6960 tempest-MultipleCreateTestJSON-605630201 tempest-MultipleCreateTestJSON-605630201-project-member] Enqueued Resource ID: d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f with Priority: HIGHEST for action security_group_members [ 991.960077] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f with Priority: HIGHEST for action security_group_members [ 991.960458] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.960566] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.101146] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e5f0086-b1e3-4f00-8207-8306f153d0e4 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.101394] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.101445] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f0b7a9ee-c7eb-4fed-8202-3e66f51ebc34 with status ACTIVE [ 992.101655] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.101776] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.101776] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.102107] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.102107] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.102346] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.102346] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.102436] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.102897] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.102897] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.102897] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.102897] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.103078] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.103078] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.103160] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.103241] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f0b7a9ee-c7eb-4fed-8202-3e66f51ebc34 is going to be updated. [ 992.127592] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.127790] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.127856] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.128030] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.128176] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.128335] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f0b7a9ee-c7eb-4fed-8202-3e66f51ebc34" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.336141] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.356557] env[65065]: INFO networking_nsxv3.common.synchronization [req-b033339e-f619-42aa-ab8f-2ab5aec33716 req-8523a2ea-c1c7-4acb-b1ac-741895354b6f tempest-DeleteServersTestJSON-1316666736 tempest-DeleteServersTestJSON-1316666736-project-member] Enqueued Resource ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 with Priority: HIGHEST for action security_group_members [ 992.357522] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 with Priority: HIGHEST for action security_group_members [ 992.358416] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d0941d4-57d8-45e9-9f2f-95128b8136e5 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.358416] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.358416] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.358416] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.358617] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.358617] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.358768] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.358930] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.359038] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.359135] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d0941d4-57d8-45e9-9f2f-95128b8136e5',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.794972] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock network-950 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.795253] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "network-950" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.795389] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "network-950" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.795824] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "network-950" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.795985] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.796172] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.796342] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.796656] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.796819] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.797075] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 992.797188] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 992.797298] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 992.797405] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 992.797516] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 992.797618] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 992.797779] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 992.821759] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 992.821914] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 992.822147] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 992.822560] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "network-950" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.822895] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock port-8d811695-1853-47c4-89f5-128d933d2b5c taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.823089] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "port-8d811695-1853-47c4-89f5-128d933d2b5c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.823212] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "port-8d811695-1853-47c4-89f5-128d933d2b5c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.823562] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "port-8d811695-1853-47c4-89f5-128d933d2b5c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.823697] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8d811695-1853-47c4-89f5-128d933d2b5c',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.840242] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.861510] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.861680] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.861738] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.861964] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.862045] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.862253] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.862355] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.862418] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.862577] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.862654] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.862746] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 is going to be updated. [ 992.897253] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.897501] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.897501] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.897687] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.897814] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.913056] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 in Status: IN_PROGRESS for 2s [ 993.170414] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f in Status: SUCCESS [ 993.170787] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.170838] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.171051] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.171141] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.327328] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.327534] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.327670] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.328177] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.328365] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.328527] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Segment Port 8d811695-1853-47c4-89f5-128d933d2b5c not found, creating... [ 993.328815] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.329040] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.329162] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.329399] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.329615] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.330062] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.330159] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.330245] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.330478] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.330908] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.331065] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Resource: SegmentPort with ID: 8d811695-1853-47c4-89f5-128d933d2b5c is going to be created. [ 993.343131] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.343307] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.343384] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.343639] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.343729] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.343860] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f is going to be updated. [ 993.355633] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.355897] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.355965] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.356245] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.356474] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.356763] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "port-8d811695-1853-47c4-89f5-128d933d2b5c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.388367] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.388558] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.388694] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.388908] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.389094] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.446603] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 in Status: SUCCESS [ 993.446871] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.447538] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.448149] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.448372] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.448531] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.448616] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.448856] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.448985] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.449252] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e5f0086-b1e3-4f00-8207-8306f153d0e4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.451345] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f in Status: IN_PROGRESS for 2s [ 993.704040] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.704904] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.704904] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.704904] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.704904] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.704904] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f is going to be deleted. [ 993.774982] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.775146] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.775242] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.775436] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.775650] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.775650] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.839047] env[65065]: INFO networking_nsxv3.common.synchronization [req-56d03c2a-6328-4310-99b9-70b6e49031c5 req-4ddc5d41-f489-4052-a9ac-53f22459d35d tempest-ServerActionsTestJSON-1279756280 tempest-ServerActionsTestJSON-1279756280-project-member] Enqueued Resource ID: 1a8690bf-b436-47bf-abed-9ade6d6d5c3f with Priority: HIGHEST for action security_group_members [ 993.839460] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a8690bf-b436-47bf-abed-9ade6d6d5c3f with Priority: HIGHEST for action security_group_members [ 993.839792] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-1a8690bf-b436-47bf-abed-9ade6d6d5c3f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.839941] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1a8690bf-b436-47bf-abed-9ade6d6d5c3f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.840226] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1a8690bf-b436-47bf-abed-9ade6d6d5c3f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.840226] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1a8690bf-b436-47bf-abed-9ade6d6d5c3f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.840468] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.840468] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.840557] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.840736] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.840736] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.840824] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1a8690bf-b436-47bf-abed-9ade6d6d5c3f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.952434] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1e5f0086-b1e3-4f00-8207-8306f153d0e4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.105020] env[65065]: INFO networking_nsxv3.common.synchronization [req-b033339e-f619-42aa-ab8f-2ab5aec33716 req-8ce3e58f-6031-41b5-8528-c121b924a1f5 service nova] Enqueued Resource ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 with Priority: HIGHEST for action security_group_rules [ 994.105020] env[65065]: INFO networking_nsxv3.common.synchronization [req-b033339e-f619-42aa-ab8f-2ab5aec33716 req-8ce3e58f-6031-41b5-8528-c121b924a1f5 service nova] Enqueued Resource ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 with Priority: HIGHEST for action security_group_members [ 994.105020] env[65065]: INFO networking_nsxv3.common.synchronization [req-b033339e-f619-42aa-ab8f-2ab5aec33716 req-8ce3e58f-6031-41b5-8528-c121b924a1f5 service nova] Enqueued Resource ID: 8d811695-1853-47c4-89f5-128d933d2b5c with Priority: HIGHEST for action port [ 994.105345] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 with Priority: HIGHEST for action security_group_rules [ 994.105440] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 with Priority: HIGHEST for action security_group_members [ 994.105535] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d811695-1853-47c4-89f5-128d933d2b5c with Priority: HIGHEST for action port [ 994.106188] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7d0941d4-57d8-45e9-9f2f-95128b8136e5 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.106354] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.106415] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.107057] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.107302] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7d0941d4-57d8-45e9-9f2f-95128b8136e5',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.109102] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d0941d4-57d8-45e9-9f2f-95128b8136e5 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.109201] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.109400] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-8d811695-1853-47c4-89f5-128d933d2b5c taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.109491] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8d811695-1853-47c4-89f5-128d933d2b5c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.109551] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8d811695-1853-47c4-89f5-128d933d2b5c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.113020] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8d811695-1853-47c4-89f5-128d933d2b5c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.113020] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8d811695-1853-47c4-89f5-128d933d2b5c',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.343792] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.343792] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.343792] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.343792] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.343792] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.344592] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.345423] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.345519] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.345997] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.345997] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.345997] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1a8690bf-b436-47bf-abed-9ade6d6d5c3f is going to be updated. [ 994.378901] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.379063] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.379180] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.379422] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.379513] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.390643] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1a8690bf-b436-47bf-abed-9ade6d6d5c3f in Status: IN_PROGRESS for 2s [ 994.455937] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1e5f0086-b1e3-4f00-8207-8306f153d0e4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.610376] env[65065]: INFO networking_nsxv3.common.synchronization [req-9cdc67ab-cf52-4e5f-a459-afcc1cdfadc1 req-97f398f5-8c1f-41b8-9cc1-471263e43499 tempest-ServerActionsV293TestJSON-337812631 tempest-ServerActionsV293TestJSON-337812631-project-member] Enqueued Resource ID: 37c3f83a-5710-4c20-abeb-08e60639bed8 with Priority: HIGHEST for action security_group_members [ 994.611144] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37c3f83a-5710-4c20-abeb-08e60639bed8 with Priority: HIGHEST for action security_group_members [ 994.611359] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-37c3f83a-5710-4c20-abeb-08e60639bed8 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.611473] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37c3f83a-5710-4c20-abeb-08e60639bed8" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.611668] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37c3f83a-5710-4c20-abeb-08e60639bed8" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.611882] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37c3f83a-5710-4c20-abeb-08e60639bed8" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.612259] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.612425] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.612490] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.612654] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.612750] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.612895] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('37c3f83a-5710-4c20-abeb-08e60639bed8',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.613776] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d0941d4-57d8-45e9-9f2f-95128b8136e5 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.613871] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.614455] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8d811695-1853-47c4-89f5-128d933d2b5c with status ACTIVE [ 994.614618] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.614730] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.614796] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.615027] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.615120] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.615462] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.615462] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.615462] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.615617] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.615648] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.615824] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.615890] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.615948] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.616100] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.616222] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.616310] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8d811695-1853-47c4-89f5-128d933d2b5c is going to be updated. [ 994.641335] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.641495] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.641495] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.641676] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.641794] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.641924] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8d811695-1853-47c4-89f5-128d933d2b5c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.924174] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 in Status: SUCCESS [ 994.924375] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 deletion is rescheduled due to dependency. [ 994.924467] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.924636] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.924878] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.925082] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.925202] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.925266] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.925426] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.925509] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.925602] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d0941d4-57d8-45e9-9f2f-95128b8136e5',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.957875] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.958189] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.958189] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.958315] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.958402] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.958503] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 is going to be updated. [ 994.965681] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock network-353 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.965878] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "network-353" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.966021] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "network-353" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.966348] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "network-353" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.966602] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.966755] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.966877] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.967093] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.967242] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.967445] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 994.967556] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 994.967669] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 994.967783] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 994.967892] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 994.968019] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 994.968136] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 994.992334] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 994.992498] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 994.992640] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 994.992865] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "network-353" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.993168] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock port-2d76a3ad-e1e1-4ed5-8199-49699a8d2f76 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.993341] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "port-2d76a3ad-e1e1-4ed5-8199-49699a8d2f76" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.993456] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "port-2d76a3ad-e1e1-4ed5-8199-49699a8d2f76" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.993862] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "port-2d76a3ad-e1e1-4ed5-8199-49699a8d2f76" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.994023] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2d76a3ad-e1e1-4ed5-8199-49699a8d2f76',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.995961] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.996104] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.996169] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.996354] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.996499] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.006421] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 in Status: IN_PROGRESS for 2s [ 995.114714] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.114898] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.114938] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.115177] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.115270] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.115561] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.115675] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.115724] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.115868] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.115944] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.116074] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37c3f83a-5710-4c20-abeb-08e60639bed8 already deleted. [ 995.116157] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37c3f83a-5710-4c20-abeb-08e60639bed8" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.428349] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7d0941d4-57d8-45e9-9f2f-95128b8136e5',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.461561] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f in Status: SUCCESS [ 995.461834] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.462027] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.462249] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.462439] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.462552] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.462616] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.462764] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.462844] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.462936] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.499211] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.499459] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.499570] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.499934] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.500173] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.500304] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Segment Port 2d76a3ad-e1e1-4ed5-8199-49699a8d2f76 not found, creating... [ 995.500566] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.500725] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.500883] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.501102] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.501243] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.501529] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.501679] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.501799] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.502019] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.502148] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.502283] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Resource: SegmentPort with ID: 2d76a3ad-e1e1-4ed5-8199-49699a8d2f76 is going to be created. [ 995.524387] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.524653] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.524722] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.525052] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.525297] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.525514] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "port-2d76a3ad-e1e1-4ed5-8199-49699a8d2f76" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.932528] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7d0941d4-57d8-45e9-9f2f-95128b8136e5',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.966327] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.966327] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.966466] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.966636] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.966813] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.967217] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.967217] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.967217] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.967430] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.967430] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.967517] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f is going to be deleted. [ 995.997957] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.998235] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.998235] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.998445] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.998541] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.998629] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9b5c2d7-ecd0-4e0b-a4b2-08092efb0a8f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.226080] env[65065]: INFO networking_nsxv3.common.synchronization [req-9cdc67ab-cf52-4e5f-a459-afcc1cdfadc1 req-c84d2429-a1f1-4b71-9704-b2dcbb863303 service nova] Enqueued Resource ID: 37c3f83a-5710-4c20-abeb-08e60639bed8 with Priority: HIGHEST for action security_group_rules [ 996.226294] env[65065]: INFO networking_nsxv3.common.synchronization [req-9cdc67ab-cf52-4e5f-a459-afcc1cdfadc1 req-c84d2429-a1f1-4b71-9704-b2dcbb863303 service nova] Enqueued Resource ID: 37c3f83a-5710-4c20-abeb-08e60639bed8 with Priority: HIGHEST for action security_group_members [ 996.226432] env[65065]: INFO networking_nsxv3.common.synchronization [req-9cdc67ab-cf52-4e5f-a459-afcc1cdfadc1 req-c84d2429-a1f1-4b71-9704-b2dcbb863303 service nova] Enqueued Resource ID: 2d76a3ad-e1e1-4ed5-8199-49699a8d2f76 with Priority: HIGHEST for action port [ 996.228374] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37c3f83a-5710-4c20-abeb-08e60639bed8 with Priority: HIGHEST for action security_group_rules [ 996.228521] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37c3f83a-5710-4c20-abeb-08e60639bed8 with Priority: HIGHEST for action security_group_members [ 996.228653] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d76a3ad-e1e1-4ed5-8199-49699a8d2f76 with Priority: HIGHEST for action port [ 996.230497] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-37c3f83a-5710-4c20-abeb-08e60639bed8 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.231466] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-37c3f83a-5710-4c20-abeb-08e60639bed8" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.231466] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-37c3f83a-5710-4c20-abeb-08e60639bed8" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.232420] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-37c3f83a-5710-4c20-abeb-08e60639bed8" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.232420] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('37c3f83a-5710-4c20-abeb-08e60639bed8',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.233367] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-37c3f83a-5710-4c20-abeb-08e60639bed8 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.233494] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37c3f83a-5710-4c20-abeb-08e60639bed8" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.233581] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37c3f83a-5710-4c20-abeb-08e60639bed8" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.234678] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37c3f83a-5710-4c20-abeb-08e60639bed8" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.234901] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.235087] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.235168] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.235577] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.235577] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.235577] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('37c3f83a-5710-4c20-abeb-08e60639bed8',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.236700] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-2d76a3ad-e1e1-4ed5-8199-49699a8d2f76 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.236812] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2d76a3ad-e1e1-4ed5-8199-49699a8d2f76" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.236884] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2d76a3ad-e1e1-4ed5-8199-49699a8d2f76" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.237050] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2d76a3ad-e1e1-4ed5-8199-49699a8d2f76" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.237130] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2d76a3ad-e1e1-4ed5-8199-49699a8d2f76',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.401215] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1a8690bf-b436-47bf-abed-9ade6d6d5c3f in Status: SUCCESS [ 996.401539] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1a8690bf-b436-47bf-abed-9ade6d6d5c3f deletion is rescheduled due to dependency. [ 996.401727] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1a8690bf-b436-47bf-abed-9ade6d6d5c3f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.435608] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.435608] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.436042] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.436042] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.436042] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.436153] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 is going to be updated. [ 996.468654] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.468808] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.468886] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.469152] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.469299] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.479812] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 in Status: IN_PROGRESS for 2s [ 996.739998] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('37c3f83a-5710-4c20-abeb-08e60639bed8',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.741387] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-37c3f83a-5710-4c20-abeb-08e60639bed8 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.741566] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37c3f83a-5710-4c20-abeb-08e60639bed8" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.742690] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2d76a3ad-e1e1-4ed5-8199-49699a8d2f76 with status ACTIVE [ 996.742908] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.743197] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.743322] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.743715] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.743951] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.744157] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.744299] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.744384] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.744601] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.744710] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.745104] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.745251] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.745334] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.745513] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.745631] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.745739] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2d76a3ad-e1e1-4ed5-8199-49699a8d2f76 is going to be updated. [ 996.859505] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.859919] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.859919] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.860497] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.860497] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.860857] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2d76a3ad-e1e1-4ed5-8199-49699a8d2f76" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.018893] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 in Status: SUCCESS [ 997.019106] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.019302] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.019501] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.019701] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.019891] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.019957] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.020152] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.020241] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.020326] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.020432] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1e5f0086-b1e3-4f00-8207-8306f153d0e4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.248804] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('37c3f83a-5710-4c20-abeb-08e60639bed8',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.529399] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e5f0086-b1e3-4f00-8207-8306f153d0e4 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.529399] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.529399] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.529399] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.529399] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.529399] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.529399] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.529399] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.529399] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.529399] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.529399] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e5f0086-b1e3-4f00-8207-8306f153d0e4 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.529399] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.529399] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.529399] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.529399] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.529399] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.532429] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.532429] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.532429] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.532429] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.532429] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1e5f0086-b1e3-4f00-8207-8306f153d0e4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.532429] env[65065]: INFO networking_nsxv3.common.synchronization [req-f3200e70-b9f4-4c7f-b6de-ec26a0405005 req-784a2d91-216e-4302-9d03-52e954808dda tempest-AttachInterfacesUnderV243Test-339300557 tempest-AttachInterfacesUnderV243Test-339300557-project-member] Enqueued Resource ID: edcd6c4a-2692-4c72-ae97-49015334375d with Priority: HIGHEST for action security_group_members [ 997.532429] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: edcd6c4a-2692-4c72-ae97-49015334375d with Priority: HIGHEST for action security_group_members [ 997.532854] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-edcd6c4a-2692-4c72-ae97-49015334375d taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.532854] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-edcd6c4a-2692-4c72-ae97-49015334375d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.532969] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-edcd6c4a-2692-4c72-ae97-49015334375d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.533799] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-edcd6c4a-2692-4c72-ae97-49015334375d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.533799] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.533799] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.533799] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.533799] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.533799] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.533799] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('edcd6c4a-2692-4c72-ae97-49015334375d',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.571415] env[65065]: INFO networking_nsxv3.common.synchronization [req-f3200e70-b9f4-4c7f-b6de-ec26a0405005 req-784a2d91-216e-4302-9d03-52e954808dda tempest-AttachInterfacesUnderV243Test-339300557 tempest-AttachInterfacesUnderV243Test-339300557-project-member] Enqueued Resource ID: edcd6c4a-2692-4c72-ae97-49015334375d with Priority: HIGHEST for action security_group_rules [ 997.571558] env[65065]: INFO networking_nsxv3.common.synchronization [req-f3200e70-b9f4-4c7f-b6de-ec26a0405005 req-784a2d91-216e-4302-9d03-52e954808dda tempest-AttachInterfacesUnderV243Test-339300557 tempest-AttachInterfacesUnderV243Test-339300557-project-member] Enqueued Resource ID: edcd6c4a-2692-4c72-ae97-49015334375d with Priority: HIGHEST for action security_group_members [ 997.571744] env[65065]: INFO networking_nsxv3.common.synchronization [req-f3200e70-b9f4-4c7f-b6de-ec26a0405005 req-784a2d91-216e-4302-9d03-52e954808dda tempest-AttachInterfacesUnderV243Test-339300557 tempest-AttachInterfacesUnderV243Test-339300557-project-member] Enqueued Resource ID: 88795fd9-14f0-460f-a75a-d0a6cf247cdf with Priority: HIGHEST for action port [ 997.572302] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: edcd6c4a-2692-4c72-ae97-49015334375d with Priority: HIGHEST for action security_group_rules [ 997.572448] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: edcd6c4a-2692-4c72-ae97-49015334375d with Priority: HIGHEST for action security_group_members [ 997.572594] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88795fd9-14f0-460f-a75a-d0a6cf247cdf with Priority: HIGHEST for action port [ 997.573472] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-edcd6c4a-2692-4c72-ae97-49015334375d taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.573472] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-edcd6c4a-2692-4c72-ae97-49015334375d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.573472] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-edcd6c4a-2692-4c72-ae97-49015334375d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.573472] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-edcd6c4a-2692-4c72-ae97-49015334375d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.573472] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('edcd6c4a-2692-4c72-ae97-49015334375d',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.574837] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-edcd6c4a-2692-4c72-ae97-49015334375d taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.574837] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-edcd6c4a-2692-4c72-ae97-49015334375d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.574837] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-88795fd9-14f0-460f-a75a-d0a6cf247cdf taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.574837] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-88795fd9-14f0-460f-a75a-d0a6cf247cdf" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.574837] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-88795fd9-14f0-460f-a75a-d0a6cf247cdf" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.575046] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-88795fd9-14f0-460f-a75a-d0a6cf247cdf" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.575085] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('88795fd9-14f0-460f-a75a-d0a6cf247cdf',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.752041] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.752977] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.753173] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.753368] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.753461] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.753568] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37c3f83a-5710-4c20-abeb-08e60639bed8 is going to be created. [ 997.782875] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.782875] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.782875] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.782875] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.782875] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.796362] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37c3f83a-5710-4c20-abeb-08e60639bed8 in Status: UNINITIALIZED for 2s [ 998.032651] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1e5f0086-b1e3-4f00-8207-8306f153d0e4: rpc.has_security_group_logging(os_id): False [ 998.037126] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('edcd6c4a-2692-4c72-ae97-49015334375d',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.052459] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.052614] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.052706] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.052943] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.053040] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.053251] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.053347] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.053408] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.053582] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.053617] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.053792] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.053885] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.053943] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.054094] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.054167] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.054446] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.054542] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.054602] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.054738] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.054810] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.054894] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 is going to be updated. [ 998.080798] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 88795fd9-14f0-460f-a75a-d0a6cf247cdf with status ACTIVE [ 998.081869] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.081869] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.081869] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.081869] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.081869] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.081869] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.081869] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.081869] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.082379] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.082379] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.082379] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.082379] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.082379] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.082578] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.082578] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.082640] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 88795fd9-14f0-460f-a75a-d0a6cf247cdf is going to be updated. [ 998.084245] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-edcd6c4a-2692-4c72-ae97-49015334375d taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.084349] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-edcd6c4a-2692-4c72-ae97-49015334375d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.106130] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.106332] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.106332] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.106527] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.106641] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.106798] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-88795fd9-14f0-460f-a75a-d0a6cf247cdf" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.116892] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.117043] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.117110] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.117305] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.117442] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.137839] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 in Status: IN_PROGRESS for 2s [ 998.490450] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 in Status: SUCCESS [ 998.490680] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.490870] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.491099] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.491325] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.492042] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.492042] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.492042] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.492042] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.492042] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.492042] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7d0941d4-57d8-45e9-9f2f-95128b8136e5',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.543130] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('edcd6c4a-2692-4c72-ae97-49015334375d',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.994091] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d0941d4-57d8-45e9-9f2f-95128b8136e5 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.994299] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.994370] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.994670] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.994900] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.994972] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.995120] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.995254] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.995359] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.995486] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.995675] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d0941d4-57d8-45e9-9f2f-95128b8136e5 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.995764] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.995826] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.995983] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.996181] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.996341] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.996406] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.996527] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.996602] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.996681] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.996768] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7d0941d4-57d8-45e9-9f2f-95128b8136e5',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.045547] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.045749] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.045802] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.045993] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.046095] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.046200] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: edcd6c4a-2692-4c72-ae97-49015334375d is going to be updated. [ 999.085123] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.085368] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.085443] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.085685] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.085899] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.096482] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: edcd6c4a-2692-4c72-ae97-49015334375d in Status: IN_PROGRESS for 2s [ 999.499442] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7d0941d4-57d8-45e9-9f2f-95128b8136e5: rpc.has_security_group_logging(os_id): False [ 999.517530] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.517737] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.517737] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.517951] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.518099] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.518257] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.518373] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.518447] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.518626] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.518704] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.518909] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.519077] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.519202] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.519416] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.519537] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.519805] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.519930] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.519990] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.520147] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.520569] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.520569] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 is going to be updated. [ 999.579687] env[65065]: INFO networking_nsxv3.common.synchronization [req-9601804b-b2c5-4fd3-b893-e4112eba2d96 req-eedec137-9a6c-4df0-bfb1-17f3c9309826 tempest-ServerDiskConfigTestJSON-975440465 tempest-ServerDiskConfigTestJSON-975440465-project-member] Enqueued Resource ID: ffd44fac-c762-408c-862b-ccea34e00947 with Priority: HIGHEST for action security_group_members [ 999.579687] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ffd44fac-c762-408c-862b-ccea34e00947 with Priority: HIGHEST for action security_group_members [ 999.579687] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-ffd44fac-c762-408c-862b-ccea34e00947 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.579687] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.579687] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.580244] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.580505] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.580725] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.580912] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.581210] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.581664] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.581899] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ffd44fac-c762-408c-862b-ccea34e00947',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.586166] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.586285] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.586331] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.586522] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.586664] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.602277] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 in Status: IN_PROGRESS for 2s [ 999.807095] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37c3f83a-5710-4c20-abeb-08e60639bed8 in Status: UNINITIALIZED for 4s [ 1000.084312] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.084597] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.084738] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.085080] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.085245] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.085570] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.085724] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.085826] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.086068] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.086140] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.086236] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ffd44fac-c762-408c-862b-ccea34e00947 is going to be updated. [ 1000.119610] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.119847] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.119847] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.120156] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.120254] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.135511] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ffd44fac-c762-408c-862b-ccea34e00947 in Status: IN_PROGRESS for 2s [ 1000.162930] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 in Status: SUCCESS [ 1000.162930] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.651484] env[65065]: INFO networking_nsxv3.common.synchronization [req-119c7502-4cb8-4080-bd7f-438143ad2a09 req-0cec5d04-8e22-4529-b026-a03cf0ea7a64 tempest-AttachInterfacesUnderV243Test-339300557 tempest-AttachInterfacesUnderV243Test-339300557-project-member] Enqueued Resource ID: edcd6c4a-2692-4c72-ae97-49015334375d with Priority: HIGHEST for action security_group_members [ 1000.652074] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: edcd6c4a-2692-4c72-ae97-49015334375d with Priority: HIGHEST for action security_group_members [ 1000.652608] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-edcd6c4a-2692-4c72-ae97-49015334375d taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.653605] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-edcd6c4a-2692-4c72-ae97-49015334375d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.674758] env[65065]: INFO networking_nsxv3.common.synchronization [req-119c7502-4cb8-4080-bd7f-438143ad2a09 req-0cec5d04-8e22-4529-b026-a03cf0ea7a64 tempest-AttachInterfacesUnderV243Test-339300557 tempest-AttachInterfacesUnderV243Test-339300557-project-member] Enqueued Resource ID: edcd6c4a-2692-4c72-ae97-49015334375d with Priority: HIGHEST for action security_group_rules [ 1000.674963] env[65065]: INFO networking_nsxv3.common.synchronization [req-119c7502-4cb8-4080-bd7f-438143ad2a09 req-0cec5d04-8e22-4529-b026-a03cf0ea7a64 tempest-AttachInterfacesUnderV243Test-339300557 tempest-AttachInterfacesUnderV243Test-339300557-project-member] Enqueued Resource ID: edcd6c4a-2692-4c72-ae97-49015334375d with Priority: HIGHEST for action security_group_members [ 1000.675089] env[65065]: INFO networking_nsxv3.common.synchronization [req-119c7502-4cb8-4080-bd7f-438143ad2a09 req-0cec5d04-8e22-4529-b026-a03cf0ea7a64 tempest-AttachInterfacesUnderV243Test-339300557 tempest-AttachInterfacesUnderV243Test-339300557-project-member] Enqueued Resource ID: 88795fd9-14f0-460f-a75a-d0a6cf247cdf with Priority: HIGHEST for action port [ 1000.675641] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: edcd6c4a-2692-4c72-ae97-49015334375d with Priority: HIGHEST for action security_group_rules [ 1000.675778] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: edcd6c4a-2692-4c72-ae97-49015334375d with Priority: HIGHEST for action security_group_members [ 1000.675876] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88795fd9-14f0-460f-a75a-d0a6cf247cdf with Priority: HIGHEST for action port [ 1000.676165] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-edcd6c4a-2692-4c72-ae97-49015334375d taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.676331] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-edcd6c4a-2692-4c72-ae97-49015334375d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.676456] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-edcd6c4a-2692-4c72-ae97-49015334375d taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.676537] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-edcd6c4a-2692-4c72-ae97-49015334375d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.676710] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-88795fd9-14f0-460f-a75a-d0a6cf247cdf taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.676808] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-88795fd9-14f0-460f-a75a-d0a6cf247cdf" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.676871] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-88795fd9-14f0-460f-a75a-d0a6cf247cdf" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.677089] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-88795fd9-14f0-460f-a75a-d0a6cf247cdf" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.677171] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('88795fd9-14f0-460f-a75a-d0a6cf247cdf',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.116413] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: edcd6c4a-2692-4c72-ae97-49015334375d in Status: SUCCESS [ 1001.116413] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-edcd6c4a-2692-4c72-ae97-49015334375d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.116413] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-edcd6c4a-2692-4c72-ae97-49015334375d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.116413] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-edcd6c4a-2692-4c72-ae97-49015334375d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.116413] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.116413] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.116413] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.116413] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.116413] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.116413] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('edcd6c4a-2692-4c72-ae97-49015334375d',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.182367] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 88795fd9-14f0-460f-a75a-d0a6cf247cdf with status ACTIVE [ 1001.182498] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.182633] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.182807] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.186030] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.186030] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.186030] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.186030] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.186030] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.186030] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.186030] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.186030] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.186030] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.186030] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.186030] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.186030] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.186030] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 88795fd9-14f0-460f-a75a-d0a6cf247cdf is going to be updated. [ 1001.211662] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.211857] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.211936] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.212266] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.212476] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.212702] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-88795fd9-14f0-460f-a75a-d0a6cf247cdf" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.618683] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('edcd6c4a-2692-4c72-ae97-49015334375d',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.627442] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 in Status: SUCCESS [ 1001.627693] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.821588] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37c3f83a-5710-4c20-abeb-08e60639bed8 in Status: SUCCESS [ 1001.821588] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37c3f83a-5710-4c20-abeb-08e60639bed8" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.821588] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37c3f83a-5710-4c20-abeb-08e60639bed8" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.822104] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37c3f83a-5710-4c20-abeb-08e60639bed8" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.822104] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.822104] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.822104] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.822367] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.822367] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.822367] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37c3f83a-5710-4c20-abeb-08e60639bed8" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.822555] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('37c3f83a-5710-4c20-abeb-08e60639bed8',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.121377] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('edcd6c4a-2692-4c72-ae97-49015334375d',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.148019] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ffd44fac-c762-408c-862b-ccea34e00947 in Status: SUCCESS [ 1002.148297] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ffd44fac-c762-408c-862b-ccea34e00947 deletion is rescheduled due to dependency. [ 1002.148402] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.326264] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('37c3f83a-5710-4c20-abeb-08e60639bed8',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.623879] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.624388] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.624388] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.624388] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.624603] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.624730] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: edcd6c4a-2692-4c72-ae97-49015334375d is going to be updated. [ 1002.664267] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.664267] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.664459] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.664820] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.664820] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.685519] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: edcd6c4a-2692-4c72-ae97-49015334375d in Status: IN_PROGRESS for 2s [ 1002.829202] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 37c3f83a-5710-4c20-abeb-08e60639bed8: rpc.has_security_group_logging(os_id): False [ 1002.849342] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.849503] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.849503] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.850184] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.850184] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.850184] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.850374] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.850374] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.850458] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.850510] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.850596] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 37c3f83a-5710-4c20-abeb-08e60639bed8 is going to be created. [ 1002.944604] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.944862] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.944862] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.945057] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.945260] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.958187] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 37c3f83a-5710-4c20-abeb-08e60639bed8 in Status: IN_PROGRESS for 2s [ 1003.264335] env[65065]: INFO networking_nsxv3.common.synchronization [req-83cf5141-a569-41d5-8708-3618b742bdb9 req-16a830cf-1914-4036-bbc2-445221e820b1 tempest-ServersTestMultiNic-1110836678 tempest-ServersTestMultiNic-1110836678-project-member] Enqueued Resource ID: e9de3df0-a5b4-4be3-a63b-4d4baf532bbc with Priority: HIGHEST for action security_group_members [ 1003.265830] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9de3df0-a5b4-4be3-a63b-4d4baf532bbc with Priority: HIGHEST for action security_group_members [ 1003.266439] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.266594] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.266679] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.266999] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.267227] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.267342] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.267408] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.267572] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.267658] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.267830] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e9de3df0-a5b4-4be3-a63b-4d4baf532bbc',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.666234] env[65065]: INFO networking_nsxv3.common.synchronization [req-83cf5141-a569-41d5-8708-3618b742bdb9 req-0db7ad72-062a-472d-8d87-3ee195f2e38f tempest-ServersTestMultiNic-1110836678 tempest-ServersTestMultiNic-1110836678-project-member] Enqueued Resource ID: e9de3df0-a5b4-4be3-a63b-4d4baf532bbc with Priority: HIGHEST for action security_group_members [ 1003.666896] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9de3df0-a5b4-4be3-a63b-4d4baf532bbc with Priority: HIGHEST for action security_group_members [ 1003.667301] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.667568] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.770968] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.771269] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.771372] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.773226] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.773226] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.773226] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.773226] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.773226] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.773226] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.773226] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.773226] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e9de3df0-a5b4-4be3-a63b-4d4baf532bbc is going to be updated. [ 1003.809814] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.809814] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.809814] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.809814] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.809814] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.818214] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9de3df0-a5b4-4be3-a63b-4d4baf532bbc in Status: IN_PROGRESS for 2s [ 1004.125813] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock network-205 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.126140] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "network-205" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.126140] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "network-205" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.126461] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "network-205" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.126708] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.126864] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.126980] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.127393] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.127546] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.127752] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1004.127864] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1004.127969] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1004.128088] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1004.128197] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1004.128299] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1004.128427] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1004.150524] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1004.150696] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1004.150839] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1004.151033] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "network-205" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.151411] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock port-2a530abc-c920-4815-b065-51e5a18dc42f taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.151588] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "port-2a530abc-c920-4815-b065-51e5a18dc42f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.151705] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "port-2a530abc-c920-4815-b065-51e5a18dc42f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.152083] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "port-2a530abc-c920-4815-b065-51e5a18dc42f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.152249] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2a530abc-c920-4815-b065-51e5a18dc42f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.655344] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.655592] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.655703] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.656033] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.656301] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.656529] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Segment Port 2a530abc-c920-4815-b065-51e5a18dc42f not found, creating... [ 1004.656894] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.657104] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.657223] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.657541] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.657689] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.657935] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.658123] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.658219] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.658450] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.658606] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.658741] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Resource: SegmentPort with ID: 2a530abc-c920-4815-b065-51e5a18dc42f is going to be created. [ 1004.686069] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.686307] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.686415] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.686708] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.686941] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.687174] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "port-2a530abc-c920-4815-b065-51e5a18dc42f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.699232] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: edcd6c4a-2692-4c72-ae97-49015334375d in Status: SUCCESS [ 1004.699437] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-edcd6c4a-2692-4c72-ae97-49015334375d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.699599] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-edcd6c4a-2692-4c72-ae97-49015334375d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.699908] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-edcd6c4a-2692-4c72-ae97-49015334375d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.700123] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.700244] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.700304] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.700463] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.700544] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.700624] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-edcd6c4a-2692-4c72-ae97-49015334375d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.700726] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('edcd6c4a-2692-4c72-ae97-49015334375d',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.701582] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-edcd6c4a-2692-4c72-ae97-49015334375d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.701753] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-edcd6c4a-2692-4c72-ae97-49015334375d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.701909] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.702027] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.702088] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.702228] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.702305] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.702389] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('edcd6c4a-2692-4c72-ae97-49015334375d',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.972868] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 37c3f83a-5710-4c20-abeb-08e60639bed8 in Status: SUCCESS [ 1004.973152] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-37c3f83a-5710-4c20-abeb-08e60639bed8" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.091233] env[65065]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-5dc288ef-8933-4403-998f-272fe36b910d None None] NSXv3 Agent Agent loop - iteration:1 completed [ 1005.091511] env[65065]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-5dc288ef-8933-4403-998f-272fe36b910d None None] NSXv3 Agent Agent loop - iteration:2 started [ 1005.204449] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('edcd6c4a-2692-4c72-ae97-49015334375d',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.205575] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('edcd6c4a-2692-4c72-ae97-49015334375d',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.396345] env[65065]: INFO networking_nsxv3.common.synchronization [req-83cf5141-a569-41d5-8708-3618b742bdb9 req-5f5ec23d-642f-49df-b926-afd89400e409 service nova] Enqueued Resource ID: e9de3df0-a5b4-4be3-a63b-4d4baf532bbc with Priority: HIGHEST for action security_group_rules [ 1005.396345] env[65065]: INFO networking_nsxv3.common.synchronization [req-83cf5141-a569-41d5-8708-3618b742bdb9 req-5f5ec23d-642f-49df-b926-afd89400e409 service nova] Enqueued Resource ID: e9de3df0-a5b4-4be3-a63b-4d4baf532bbc with Priority: HIGHEST for action security_group_members [ 1005.396345] env[65065]: INFO networking_nsxv3.common.synchronization [req-83cf5141-a569-41d5-8708-3618b742bdb9 req-5f5ec23d-642f-49df-b926-afd89400e409 service nova] Enqueued Resource ID: 2a530abc-c920-4815-b065-51e5a18dc42f with Priority: HIGHEST for action port [ 1005.396345] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9de3df0-a5b4-4be3-a63b-4d4baf532bbc with Priority: HIGHEST for action security_group_rules [ 1005.399256] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9de3df0-a5b4-4be3-a63b-4d4baf532bbc with Priority: HIGHEST for action security_group_members [ 1005.399256] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a530abc-c920-4815-b065-51e5a18dc42f with Priority: HIGHEST for action port [ 1005.399256] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.399256] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.399256] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.399256] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.399256] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e9de3df0-a5b4-4be3-a63b-4d4baf532bbc',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.399256] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.400747] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.400747] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-2a530abc-c920-4815-b065-51e5a18dc42f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.400747] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2a530abc-c920-4815-b065-51e5a18dc42f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.400747] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2a530abc-c920-4815-b065-51e5a18dc42f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.400747] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2a530abc-c920-4815-b065-51e5a18dc42f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.400747] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2a530abc-c920-4815-b065-51e5a18dc42f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.681567] env[65065]: INFO networking_nsxv3.common.synchronization [req-8a0a4dbc-c7c2-45b9-b2d9-cd7be1b2ca69 req-90d5b0a1-2b4a-4236-9532-41b5593cc378 tempest-ServersTestJSON-1126920631 tempest-ServersTestJSON-1126920631-project-member] Enqueued Resource ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 with Priority: HIGHEST for action security_group_members [ 1005.682139] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 with Priority: HIGHEST for action security_group_members [ 1005.682444] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e5f0086-b1e3-4f00-8207-8306f153d0e4 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.682563] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.682628] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.682821] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.682972] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.683236] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.683396] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.683489] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.683581] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.683950] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e5f0086-b1e3-4f00-8207-8306f153d0e4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.706912] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for edcd6c4a-2692-4c72-ae97-49015334375d: rpc.has_security_group_logging(os_id): False [ 1005.708492] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('edcd6c4a-2692-4c72-ae97-49015334375d',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.727927] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.728149] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.728221] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.728429] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.728519] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.728775] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.728886] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.728952] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.729117] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.729194] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.729281] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: edcd6c4a-2692-4c72-ae97-49015334375d is going to be updated. [ 1005.771275] env[65065]: INFO networking_nsxv3.common.synchronization [None req-25c23dc6-12e6-419d-8b63-5af9cd19d8dc None None] Enqueued Resource ID: 2f0760a2-43e4-45ca-8009-af7130feadc4 with Priority: HIGHEST for action port [ 1005.771788] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f0760a2-43e4-45ca-8009-af7130feadc4 with Priority: HIGHEST for action port [ 1005.772162] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-2f0760a2-43e4-45ca-8009-af7130feadc4 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.772429] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2f0760a2-43e4-45ca-8009-af7130feadc4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.772543] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2f0760a2-43e4-45ca-8009-af7130feadc4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.772755] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2f0760a2-43e4-45ca-8009-af7130feadc4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.772841] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2f0760a2-43e4-45ca-8009-af7130feadc4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.792353] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.792504] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.792569] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.792752] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.792958] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.814244] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: edcd6c4a-2692-4c72-ae97-49015334375d in Status: IN_PROGRESS for 2s [ 1005.838552] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9de3df0-a5b4-4be3-a63b-4d4baf532bbc in Status: SUCCESS [ 1005.838723] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e9de3df0-a5b4-4be3-a63b-4d4baf532bbc deletion is rescheduled due to dependency. [ 1005.838774] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.838933] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.839167] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.839407] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.839538] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.839603] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.839782] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.839926] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.840118] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e9de3df0-a5b4-4be3-a63b-4d4baf532bbc',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.902091] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.902091] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.902765] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2a530abc-c920-4815-b065-51e5a18dc42f with status ACTIVE [ 1005.902955] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.903214] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.903326] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.903582] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.903679] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.903902] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.904026] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.904097] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.904519] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.904519] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.904747] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.904812] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.904844] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.904982] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.905146] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.905235] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2a530abc-c920-4815-b065-51e5a18dc42f is going to be updated. [ 1005.940395] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.940526] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.941335] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.941335] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.941335] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.941335] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2a530abc-c920-4815-b065-51e5a18dc42f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.965905] env[65065]: INFO networking_nsxv3.common.synchronization [req-b2bb257d-7e75-4c2a-9e6f-400197008a3a req-3176ed74-edc4-451d-a960-9bceb6b051e0 tempest-AttachInterfacesUnderV243Test-339300557 tempest-AttachInterfacesUnderV243Test-339300557-project-member] Enqueued Resource ID: edcd6c4a-2692-4c72-ae97-49015334375d with Priority: HIGHEST for action security_group_members [ 1005.966491] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: edcd6c4a-2692-4c72-ae97-49015334375d with Priority: HIGHEST for action security_group_members [ 1005.966799] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-edcd6c4a-2692-4c72-ae97-49015334375d taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.966901] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-edcd6c4a-2692-4c72-ae97-49015334375d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.187089] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1e5f0086-b1e3-4f00-8207-8306f153d0e4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.210890] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.211714] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.211714] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.211714] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.211714] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.211714] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: edcd6c4a-2692-4c72-ae97-49015334375d is going to be updated. [ 1006.253740] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.254046] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.254163] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.254386] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.254538] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.264693] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: edcd6c4a-2692-4c72-ae97-49015334375d in Status: IN_PROGRESS for 2s [ 1006.275440] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2f0760a2-43e4-45ca-8009-af7130feadc4 [ 1006.275680] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.275804] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.276056] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.276130] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.276217] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.276315] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2f0760a2-43e4-45ca-8009-af7130feadc4 already deleted. [ 1006.276429] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2f0760a2-43e4-45ca-8009-af7130feadc4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.342247] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e9de3df0-a5b4-4be3-a63b-4d4baf532bbc',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.430044] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock network-898 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.430044] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "network-898" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.430044] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "network-898" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.430044] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "network-898" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.430044] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.430044] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.430044] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.430449] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.430449] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.430511] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1006.430694] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1006.430818] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1006.430925] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1006.431053] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1006.431205] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1006.431285] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1006.453982] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1006.454509] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1006.454509] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1006.454650] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "network-898" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.454952] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock port-ff79a21c-3fbe-4eca-8af8-8559d6479b59 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.455241] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "port-ff79a21c-3fbe-4eca-8af8-8559d6479b59" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.455241] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "port-ff79a21c-3fbe-4eca-8af8-8559d6479b59" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.455829] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "port-ff79a21c-3fbe-4eca-8af8-8559d6479b59" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.455829] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ff79a21c-3fbe-4eca-8af8-8559d6479b59',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.692897] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1e5f0086-b1e3-4f00-8207-8306f153d0e4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.847404] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e9de3df0-a5b4-4be3-a63b-4d4baf532bbc',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.909645] env[65065]: INFO networking_nsxv3.common.synchronization [None req-12e7ac8c-9671-4cf2-92bc-1378e477327f tempest-AttachVolumeShelveTestJSON-217038498 tempest-AttachVolumeShelveTestJSON-217038498-project-member] Enqueued Resource ID: d0abfe3e-a5d3-4a8d-bdc5-c03daff4976f with Priority: HIGHEST for action security_group_rules [ 1006.910328] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0abfe3e-a5d3-4a8d-bdc5-c03daff4976f with Priority: HIGHEST for action security_group_rules [ 1006.910539] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d0abfe3e-a5d3-4a8d-bdc5-c03daff4976f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.910997] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d0abfe3e-a5d3-4a8d-bdc5-c03daff4976f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.910997] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d0abfe3e-a5d3-4a8d-bdc5-c03daff4976f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.911188] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d0abfe3e-a5d3-4a8d-bdc5-c03daff4976f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.911188] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d0abfe3e-a5d3-4a8d-bdc5-c03daff4976f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.958209] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.958422] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.958546] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.958861] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.959047] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.959206] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Segment Port ff79a21c-3fbe-4eca-8af8-8559d6479b59 not found, creating... [ 1006.959470] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.959619] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.959728] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.959997] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.960188] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.960870] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.961126] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.961227] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.961450] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.961586] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.961726] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Resource: SegmentPort with ID: ff79a21c-3fbe-4eca-8af8-8559d6479b59 is going to be created. [ 1006.985547] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.985547] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.985547] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.985547] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.985547] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.985547] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "port-ff79a21c-3fbe-4eca-8af8-8559d6479b59" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.069619] env[65065]: INFO networking_nsxv3.common.synchronization [None req-488d4b5e-b4f2-4035-b87f-625d0678a282 tempest-AttachVolumeShelveTestJSON-217038498 tempest-AttachVolumeShelveTestJSON-217038498-project-member] Enqueued Resource ID: d0abfe3e-a5d3-4a8d-bdc5-c03daff4976f with Priority: HIGHEST for action security_group_rules [ 1007.070658] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0abfe3e-a5d3-4a8d-bdc5-c03daff4976f with Priority: HIGHEST for action security_group_rules [ 1007.071522] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d0abfe3e-a5d3-4a8d-bdc5-c03daff4976f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.071522] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d0abfe3e-a5d3-4a8d-bdc5-c03daff4976f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.195036] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.195239] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.195459] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.195786] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.195786] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.195921] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 is going to be updated. [ 1007.231449] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.231736] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.231736] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.231937] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.232110] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.241520] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 in Status: IN_PROGRESS for 2s [ 1007.350847] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.351074] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.351130] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.351410] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.351533] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.351666] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e9de3df0-a5b4-4be3-a63b-4d4baf532bbc is going to be updated. [ 1007.381757] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.381987] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.381987] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.382218] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.382373] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.392802] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9de3df0-a5b4-4be3-a63b-4d4baf532bbc in Status: IN_PROGRESS for 2s [ 1007.432406] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.432527] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.432584] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.432792] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.432888] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.433143] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d0abfe3e-a5d3-4a8d-bdc5-c03daff4976f already deleted. [ 1007.433143] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d0abfe3e-a5d3-4a8d-bdc5-c03daff4976f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.433289] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d0abfe3e-a5d3-4a8d-bdc5-c03daff4976f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.433424] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d0abfe3e-a5d3-4a8d-bdc5-c03daff4976f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.433507] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d0abfe3e-a5d3-4a8d-bdc5-c03daff4976f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.746782] env[65065]: INFO networking_nsxv3.common.synchronization [req-83cf5141-a569-41d5-8708-3618b742bdb9 req-b8693196-ed52-44f8-8efc-c0c0566859f8 service nova] Enqueued Resource ID: e9de3df0-a5b4-4be3-a63b-4d4baf532bbc with Priority: HIGHEST for action security_group_rules [ 1007.746957] env[65065]: INFO networking_nsxv3.common.synchronization [req-83cf5141-a569-41d5-8708-3618b742bdb9 req-b8693196-ed52-44f8-8efc-c0c0566859f8 service nova] Enqueued Resource ID: e9de3df0-a5b4-4be3-a63b-4d4baf532bbc with Priority: HIGHEST for action security_group_members [ 1007.747120] env[65065]: INFO networking_nsxv3.common.synchronization [req-83cf5141-a569-41d5-8708-3618b742bdb9 req-b8693196-ed52-44f8-8efc-c0c0566859f8 service nova] Enqueued Resource ID: ff79a21c-3fbe-4eca-8af8-8559d6479b59 with Priority: HIGHEST for action port [ 1007.749766] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9de3df0-a5b4-4be3-a63b-4d4baf532bbc with Priority: HIGHEST for action security_group_rules [ 1007.749964] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9de3df0-a5b4-4be3-a63b-4d4baf532bbc with Priority: HIGHEST for action security_group_members [ 1007.750096] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff79a21c-3fbe-4eca-8af8-8559d6479b59 with Priority: HIGHEST for action port [ 1007.750401] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.750506] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.750757] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.753317] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.753317] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-ff79a21c-3fbe-4eca-8af8-8559d6479b59 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.753317] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ff79a21c-3fbe-4eca-8af8-8559d6479b59" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.753317] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ff79a21c-3fbe-4eca-8af8-8559d6479b59" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.753317] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ff79a21c-3fbe-4eca-8af8-8559d6479b59" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.753317] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ff79a21c-3fbe-4eca-8af8-8559d6479b59',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.846229] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: edcd6c4a-2692-4c72-ae97-49015334375d in Status: SUCCESS [ 1007.846516] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-edcd6c4a-2692-4c72-ae97-49015334375d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.846962] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-edcd6c4a-2692-4c72-ae97-49015334375d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.847266] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-edcd6c4a-2692-4c72-ae97-49015334375d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.847378] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('edcd6c4a-2692-4c72-ae97-49015334375d',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.950901] env[65065]: INFO networking_nsxv3.common.synchronization [None req-80eb6b1a-8f1f-4685-9035-d8859c69178d None None] Enqueued Resource ID: 2a734a2e-431e-4182-84f4-d0a15fe1568c with Priority: HIGHEST for action port [ 1007.951499] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a734a2e-431e-4182-84f4-d0a15fe1568c with Priority: HIGHEST for action port [ 1007.951822] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-2a734a2e-431e-4182-84f4-d0a15fe1568c taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.951952] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2a734a2e-431e-4182-84f4-d0a15fe1568c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.952461] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2a734a2e-431e-4182-84f4-d0a15fe1568c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.952790] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2a734a2e-431e-4182-84f4-d0a15fe1568c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.952921] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2a734a2e-431e-4182-84f4-d0a15fe1568c',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.956050] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.956050] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.956050] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.956050] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.956050] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.956401] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d0abfe3e-a5d3-4a8d-bdc5-c03daff4976f already deleted. [ 1007.956401] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d0abfe3e-a5d3-4a8d-bdc5-c03daff4976f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.071028] env[65065]: INFO networking_nsxv3.common.synchronization [req-3c8175e9-2990-4b03-9174-65c033bb26a4 req-592f3d3a-eb8e-4a67-b061-63e5b7925d0c tempest-ServerDiskConfigTestJSON-975440465 tempest-ServerDiskConfigTestJSON-975440465-project-member] Enqueued Resource ID: ffd44fac-c762-408c-862b-ccea34e00947 with Priority: HIGHEST for action security_group_members [ 1008.072041] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ffd44fac-c762-408c-862b-ccea34e00947 with Priority: HIGHEST for action security_group_members [ 1008.075506] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-ffd44fac-c762-408c-862b-ccea34e00947 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.075506] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.075506] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.075506] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.075506] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.075506] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.075506] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.075506] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.075506] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.075506] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ffd44fac-c762-408c-862b-ccea34e00947',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.257480] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ff79a21c-3fbe-4eca-8af8-8559d6479b59 with status ACTIVE [ 1008.257480] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.257480] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.257480] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.257480] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.257480] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.257480] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.257480] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.257480] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.257480] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.257480] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.257480] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.257480] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.257480] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.257480] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.257480] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.257480] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ff79a21c-3fbe-4eca-8af8-8559d6479b59 is going to be updated. [ 1008.276338] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: edcd6c4a-2692-4c72-ae97-49015334375d in Status: SUCCESS [ 1008.279022] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-edcd6c4a-2692-4c72-ae97-49015334375d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.279022] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-edcd6c4a-2692-4c72-ae97-49015334375d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.279022] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-edcd6c4a-2692-4c72-ae97-49015334375d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.279022] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.279022] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.279022] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.279022] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.279022] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.279022] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('edcd6c4a-2692-4c72-ae97-49015334375d',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.285805] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.286205] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.286961] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.286961] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.286961] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.286961] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ff79a21c-3fbe-4eca-8af8-8559d6479b59" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.381026] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock network-34 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.381026] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "network-34" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.381026] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "network-34" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.381607] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "network-34" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.385098] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.385098] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.385098] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.385098] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.385098] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.385098] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1008.385098] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1008.385098] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1008.385098] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1008.385098] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1008.385098] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1008.385098] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1008.396878] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.397377] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.397570] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.399230] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.399230] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.399230] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: edcd6c4a-2692-4c72-ae97-49015334375d is going to be deleted. [ 1008.413034] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1008.413034] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1008.413034] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1008.413034] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "network-34" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.413034] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock port-27eb9184-8855-4d31-bf45-6afda9addb0b taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.413034] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "port-27eb9184-8855-4d31-bf45-6afda9addb0b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.413034] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "port-27eb9184-8855-4d31-bf45-6afda9addb0b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.413034] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "port-27eb9184-8855-4d31-bf45-6afda9addb0b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.413034] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('27eb9184-8855-4d31-bf45-6afda9addb0b',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.457962] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2a734a2e-431e-4182-84f4-d0a15fe1568c [ 1008.457962] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.457962] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.457962] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.458295] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.458295] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.458400] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2a734a2e-431e-4182-84f4-d0a15fe1568c already deleted. [ 1008.458486] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2a734a2e-431e-4182-84f4-d0a15fe1568c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.475391] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.475605] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.475605] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.475806] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.475917] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.476074] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-edcd6c4a-2692-4c72-ae97-49015334375d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.576215] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.576487] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.576573] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.576735] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.576830] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.577046] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.577144] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.577202] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.577352] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.577963] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.577963] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ffd44fac-c762-408c-862b-ccea34e00947 is going to be updated. [ 1008.637149] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.637545] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.637545] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.637724] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.637781] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.648142] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ffd44fac-c762-408c-862b-ccea34e00947 in Status: IN_PROGRESS for 2s [ 1008.782536] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.782723] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.782788] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.782979] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.783084] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.783278] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.783377] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.783487] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.783582] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.783678] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.783741] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: edcd6c4a-2692-4c72-ae97-49015334375d is going to be deleted. [ 1008.837458] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.837850] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.837850] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.837850] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.837960] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.837990] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-edcd6c4a-2692-4c72-ae97-49015334375d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.838224] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-edcd6c4a-2692-4c72-ae97-49015334375d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.838316] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-edcd6c4a-2692-4c72-ae97-49015334375d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.838464] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.838566] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.838631] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.838805] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.838843] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.838911] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('edcd6c4a-2692-4c72-ae97-49015334375d',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.860177] env[65065]: INFO networking_nsxv3.common.synchronization [req-f8d92708-cc87-4988-8ab1-541a89039251 req-40836262-43e6-4d92-a5ee-7c2de81e8181 tempest-DeleteServersTestJSON-1316666736 tempest-DeleteServersTestJSON-1316666736-project-member] Enqueued Resource ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 with Priority: HIGHEST for action security_group_members [ 1008.860701] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 with Priority: HIGHEST for action security_group_members [ 1008.861029] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d0941d4-57d8-45e9-9f2f-95128b8136e5 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.861161] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.861226] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.861427] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.861578] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.861701] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.861755] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.862063] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.862063] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.862063] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d0941d4-57d8-45e9-9f2f-95128b8136e5',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.917178] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.917654] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.918350] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.919660] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.920075] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.922230] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Segment Port 27eb9184-8855-4d31-bf45-6afda9addb0b not found, creating... [ 1008.922654] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.922820] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.922938] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.923766] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.923999] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.924512] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.924755] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.924923] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.925242] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.925442] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.925634] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Resource: SegmentPort with ID: 27eb9184-8855-4d31-bf45-6afda9addb0b is going to be created. [ 1008.951703] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.952078] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.952621] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.952965] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.953249] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.953502] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "port-27eb9184-8855-4d31-bf45-6afda9addb0b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.253449] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 in Status: SUCCESS [ 1009.253552] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.341728] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.342186] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.342186] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.342509] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.342646] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.342933] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.343117] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.343190] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.343360] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.343514] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.343564] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: edcd6c4a-2692-4c72-ae97-49015334375d already deleted. [ 1009.343602] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-edcd6c4a-2692-4c72-ae97-49015334375d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.364353] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.364543] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.364643] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.364962] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.365113] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.365350] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.365485] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.365572] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.365766] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.365872] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.365987] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 is going to be updated. [ 1009.396087] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.396246] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.396246] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.396470] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.396663] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.404760] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9de3df0-a5b4-4be3-a63b-4d4baf532bbc in Status: SUCCESS [ 1009.404969] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.405189] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.405395] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.405767] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.405767] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.405767] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.405934] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.406020] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.406094] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e9de3df0-a5b4-4be3-a63b-4d4baf532bbc',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.407471] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 in Status: IN_PROGRESS for 2s [ 1009.686501] env[65065]: INFO networking_nsxv3.common.synchronization [req-3c8175e9-2990-4b03-9174-65c033bb26a4 req-912b64b2-2801-4848-9dab-03d4641d789a service nova] Enqueued Resource ID: ffd44fac-c762-408c-862b-ccea34e00947 with Priority: HIGHEST for action security_group_rules [ 1009.686778] env[65065]: INFO networking_nsxv3.common.synchronization [req-3c8175e9-2990-4b03-9174-65c033bb26a4 req-912b64b2-2801-4848-9dab-03d4641d789a service nova] Enqueued Resource ID: ffd44fac-c762-408c-862b-ccea34e00947 with Priority: HIGHEST for action security_group_members [ 1009.687020] env[65065]: INFO networking_nsxv3.common.synchronization [req-3c8175e9-2990-4b03-9174-65c033bb26a4 req-912b64b2-2801-4848-9dab-03d4641d789a service nova] Enqueued Resource ID: 27eb9184-8855-4d31-bf45-6afda9addb0b with Priority: HIGHEST for action port [ 1009.687541] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ffd44fac-c762-408c-862b-ccea34e00947 with Priority: HIGHEST for action security_group_rules [ 1009.687700] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ffd44fac-c762-408c-862b-ccea34e00947 with Priority: HIGHEST for action security_group_members [ 1009.688026] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27eb9184-8855-4d31-bf45-6afda9addb0b with Priority: HIGHEST for action port [ 1009.688432] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ffd44fac-c762-408c-862b-ccea34e00947 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.688556] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.688623] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.689047] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.689047] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ffd44fac-c762-408c-862b-ccea34e00947',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.689742] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-ffd44fac-c762-408c-862b-ccea34e00947 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.689873] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.691296] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-27eb9184-8855-4d31-bf45-6afda9addb0b taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.691432] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-27eb9184-8855-4d31-bf45-6afda9addb0b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.691547] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-27eb9184-8855-4d31-bf45-6afda9addb0b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.691718] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-27eb9184-8855-4d31-bf45-6afda9addb0b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.691814] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('27eb9184-8855-4d31-bf45-6afda9addb0b',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.908725] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e9de3df0-a5b4-4be3-a63b-4d4baf532bbc',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.193398] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-ffd44fac-c762-408c-862b-ccea34e00947 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.193529] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.194916] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 27eb9184-8855-4d31-bf45-6afda9addb0b with status ACTIVE [ 1010.195078] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.195207] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.195259] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.195467] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.195558] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.195730] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.195825] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.195887] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.196053] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.196129] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.196612] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.196612] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.196612] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.196612] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.196826] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.196826] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 27eb9184-8855-4d31-bf45-6afda9addb0b is going to be updated. [ 1010.219136] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.219302] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.219349] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.219543] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.219672] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.219861] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-27eb9184-8855-4d31-bf45-6afda9addb0b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.410535] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e9de3df0-a5b4-4be3-a63b-4d4baf532bbc',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.658185] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ffd44fac-c762-408c-862b-ccea34e00947 in Status: SUCCESS [ 1010.658367] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ffd44fac-c762-408c-862b-ccea34e00947 deletion is rescheduled due to dependency. [ 1010.658479] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.658636] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.658881] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.659087] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.659217] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.659283] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.659440] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.659516] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.659612] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ffd44fac-c762-408c-862b-ccea34e00947',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.916392] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.917592] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.917592] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.917592] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.917592] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.917592] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e9de3df0-a5b4-4be3-a63b-4d4baf532bbc is going to be updated. [ 1010.956071] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.956071] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.956071] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.956071] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.956394] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.968658] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9de3df0-a5b4-4be3-a63b-4d4baf532bbc in Status: IN_PROGRESS for 2s [ 1011.162361] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ffd44fac-c762-408c-862b-ccea34e00947',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.418204] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 in Status: SUCCESS [ 1011.418586] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 deletion is rescheduled due to dependency. [ 1011.418586] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.665270] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ffd44fac-c762-408c-862b-ccea34e00947',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.173459] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.173631] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.173695] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.173926] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.174028] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.174135] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ffd44fac-c762-408c-862b-ccea34e00947 is going to be updated. [ 1012.204881] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.205075] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.205451] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.205910] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.206136] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.215504] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ffd44fac-c762-408c-862b-ccea34e00947 in Status: IN_PROGRESS for 2s [ 1012.441188] env[65065]: INFO networking_nsxv3.common.synchronization [req-abadeb72-fc51-4c3d-99b0-cad0ded6a489 req-ad1cd3fd-afae-4d77-99ce-cd9467629e69 tempest-AttachInterfacesTestJSON-1590270829 tempest-AttachInterfacesTestJSON-1590270829-project-member] Enqueued Resource ID: e2e5973c-5504-4cd5-9f92-77ba0193d841 with Priority: HIGHEST for action security_group_members [ 1012.441188] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2e5973c-5504-4cd5-9f92-77ba0193d841 with Priority: HIGHEST for action security_group_members [ 1012.441188] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2e5973c-5504-4cd5-9f92-77ba0193d841 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.441954] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.442168] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.442442] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.442681] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.443501] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.443802] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.444077] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.444339] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.444523] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2e5973c-5504-4cd5-9f92-77ba0193d841',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.813135] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock network-688 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.813135] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "network-688" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.813274] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "network-688" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.813521] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "network-688" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.815116] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.815116] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.815116] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.815116] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.815116] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.815116] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1012.815116] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1012.815116] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1012.815116] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1012.815545] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1012.815545] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1012.815545] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1012.853044] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1012.853251] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Cache value generated in 0.038 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1012.853310] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1012.853503] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "network-688" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.853852] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock port-48f8073b-1ef8-42b3-a67e-88468ce5ed44 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.854060] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "port-48f8073b-1ef8-42b3-a67e-88468ce5ed44" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.854158] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "port-48f8073b-1ef8-42b3-a67e-88468ce5ed44" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.854619] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "port-48f8073b-1ef8-42b3-a67e-88468ce5ed44" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.854771] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('48f8073b-1ef8-42b3-a67e-88468ce5ed44',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.947374] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.947627] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.947701] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.948015] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.948118] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.948354] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.948485] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.948552] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.948738] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.948818] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.948982] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2e5973c-5504-4cd5-9f92-77ba0193d841 is going to be updated. [ 1012.979600] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.979835] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.979835] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.980146] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.980316] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.982870] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9de3df0-a5b4-4be3-a63b-4d4baf532bbc in Status: SUCCESS [ 1012.983085] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.983262] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.983479] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.983677] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.984364] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.984364] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.984364] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.984364] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.984364] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.984364] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e9de3df0-a5b4-4be3-a63b-4d4baf532bbc',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.985446] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.985633] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.985811] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.985923] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.985986] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.986560] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.986560] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.986560] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e9de3df0-a5b4-4be3-a63b-4d4baf532bbc',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.989654] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2e5973c-5504-4cd5-9f92-77ba0193d841 in Status: IN_PROGRESS for 2s [ 1013.357613] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.357965] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.358258] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.358579] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.358745] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.358905] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Segment Port 48f8073b-1ef8-42b3-a67e-88468ce5ed44 not found, creating... [ 1013.359192] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.359357] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.359551] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.359803] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.360042] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.360372] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.360503] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.360620] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.360830] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.360977] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.361137] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Resource: SegmentPort with ID: 48f8073b-1ef8-42b3-a67e-88468ce5ed44 is going to be created. [ 1013.381457] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.381649] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.381778] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.382072] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.382346] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.382583] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "port-48f8073b-1ef8-42b3-a67e-88468ce5ed44" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.490564] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.491035] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.491035] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e9de3df0-a5b4-4be3-a63b-4d4baf532bbc',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.993351] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e9de3df0-a5b4-4be3-a63b-4d4baf532bbc',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.114335] env[65065]: INFO networking_nsxv3.common.synchronization [req-abadeb72-fc51-4c3d-99b0-cad0ded6a489 req-b72d31aa-b0e7-4f82-80d0-1aa3fad5d919 service nova] Enqueued Resource ID: e2e5973c-5504-4cd5-9f92-77ba0193d841 with Priority: HIGHEST for action security_group_rules [ 1014.114335] env[65065]: INFO networking_nsxv3.common.synchronization [req-abadeb72-fc51-4c3d-99b0-cad0ded6a489 req-b72d31aa-b0e7-4f82-80d0-1aa3fad5d919 service nova] Enqueued Resource ID: e2e5973c-5504-4cd5-9f92-77ba0193d841 with Priority: HIGHEST for action security_group_members [ 1014.114335] env[65065]: INFO networking_nsxv3.common.synchronization [req-abadeb72-fc51-4c3d-99b0-cad0ded6a489 req-b72d31aa-b0e7-4f82-80d0-1aa3fad5d919 service nova] Enqueued Resource ID: 48f8073b-1ef8-42b3-a67e-88468ce5ed44 with Priority: HIGHEST for action port [ 1014.114335] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2e5973c-5504-4cd5-9f92-77ba0193d841 with Priority: HIGHEST for action security_group_rules [ 1014.118906] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2e5973c-5504-4cd5-9f92-77ba0193d841 with Priority: HIGHEST for action security_group_members [ 1014.119523] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48f8073b-1ef8-42b3-a67e-88468ce5ed44 with Priority: HIGHEST for action port [ 1014.121073] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e2e5973c-5504-4cd5-9f92-77ba0193d841 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.121073] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.121073] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.121073] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.121073] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e2e5973c-5504-4cd5-9f92-77ba0193d841',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.123537] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2e5973c-5504-4cd5-9f92-77ba0193d841 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.126611] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.126611] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-48f8073b-1ef8-42b3-a67e-88468ce5ed44 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.126611] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-48f8073b-1ef8-42b3-a67e-88468ce5ed44" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.126611] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-48f8073b-1ef8-42b3-a67e-88468ce5ed44" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.126611] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-48f8073b-1ef8-42b3-a67e-88468ce5ed44" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.126611] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('48f8073b-1ef8-42b3-a67e-88468ce5ed44',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.227762] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ffd44fac-c762-408c-862b-ccea34e00947 in Status: SUCCESS [ 1014.228122] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.228608] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.228911] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.229126] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.229253] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.229322] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.229484] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.229568] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.229655] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.229752] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ffd44fac-c762-408c-862b-ccea34e00947',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.498236] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.498570] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.498570] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.498783] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.498861] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.498997] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e9de3df0-a5b4-4be3-a63b-4d4baf532bbc is going to be updated. [ 1014.531163] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.531163] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.531163] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.532096] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.532314] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.542753] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9de3df0-a5b4-4be3-a63b-4d4baf532bbc in Status: IN_PROGRESS for 2s [ 1014.627697] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2e5973c-5504-4cd5-9f92-77ba0193d841 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.627961] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.628766] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 48f8073b-1ef8-42b3-a67e-88468ce5ed44 with status ACTIVE [ 1014.629120] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.629264] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.629383] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.629650] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.629745] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.630075] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.630369] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.630369] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.630545] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.630545] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.630675] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.630806] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.630884] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.630990] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.631209] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.631324] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 48f8073b-1ef8-42b3-a67e-88468ce5ed44 is going to be updated. [ 1014.657034] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.657034] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.657034] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.657034] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.657496] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.659450] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-48f8073b-1ef8-42b3-a67e-88468ce5ed44" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.736772] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-ffd44fac-c762-408c-862b-ccea34e00947 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.736772] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.736974] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.737229] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.737469] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.737669] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.737818] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.738066] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.738209] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.738374] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.738520] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-ffd44fac-c762-408c-862b-ccea34e00947 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.738707] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.738758] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.739044] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.739242] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.739367] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.740150] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.740150] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.740150] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.740150] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.740150] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ffd44fac-c762-408c-862b-ccea34e00947',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.999858] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2e5973c-5504-4cd5-9f92-77ba0193d841 in Status: SUCCESS [ 1015.000192] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2e5973c-5504-4cd5-9f92-77ba0193d841 deletion is rescheduled due to dependency. [ 1015.000231] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.000658] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.000658] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.000795] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.001040] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.001152] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.001337] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.001425] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.001529] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2e5973c-5504-4cd5-9f92-77ba0193d841',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.241577] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ffd44fac-c762-408c-862b-ccea34e00947: rpc.has_security_group_logging(os_id): False [ 1015.262424] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.262424] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.262424] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.262781] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.262781] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.262892] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.262979] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.263079] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.263253] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.263365] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.263583] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.263689] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.263770] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.263961] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.264104] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.266548] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.266663] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.266732] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.268146] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.268273] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.268371] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ffd44fac-c762-408c-862b-ccea34e00947 is going to be updated. [ 1015.341204] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.341404] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.341477] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.341710] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.341859] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.355717] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ffd44fac-c762-408c-862b-ccea34e00947 in Status: IN_PROGRESS for 2s [ 1015.504338] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e2e5973c-5504-4cd5-9f92-77ba0193d841',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.980332] env[65065]: INFO networking_nsxv3.common.synchronization [req-037025ed-c0b8-4065-955e-7296bdd2b1b5 req-fbeda260-50e5-4439-8ebf-7a2569555017 tempest-AttachVolumeShelveTestJSON-217038498 tempest-AttachVolumeShelveTestJSON-217038498-project-member] Enqueued Resource ID: d0abfe3e-a5d3-4a8d-bdc5-c03daff4976f with Priority: HIGHEST for action security_group_members [ 1015.980890] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0abfe3e-a5d3-4a8d-bdc5-c03daff4976f with Priority: HIGHEST for action security_group_members [ 1015.981774] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0abfe3e-a5d3-4a8d-bdc5-c03daff4976f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.982148] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0abfe3e-a5d3-4a8d-bdc5-c03daff4976f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.982148] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0abfe3e-a5d3-4a8d-bdc5-c03daff4976f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.982265] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0abfe3e-a5d3-4a8d-bdc5-c03daff4976f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.982421] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.982522] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.982585] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.982745] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.982830] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.982926] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d0abfe3e-a5d3-4a8d-bdc5-c03daff4976f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.006101] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e2e5973c-5504-4cd5-9f92-77ba0193d841',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.327189] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock network-470 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.327426] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "network-470" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.327553] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "network-470" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.327901] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "network-470" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.328602] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.328602] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.328602] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.328827] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.328917] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.329141] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1016.329258] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1016.329365] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1016.329479] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1016.329588] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1016.329691] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1016.329822] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1016.352311] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1016.352677] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1016.352932] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1016.353265] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "network-470" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.353702] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock port-b76f7643-3590-4fb0-9845-ac21557501c9 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.353889] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "port-b76f7643-3590-4fb0-9845-ac21557501c9" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.354076] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "port-b76f7643-3590-4fb0-9845-ac21557501c9" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.354435] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "port-b76f7643-3590-4fb0-9845-ac21557501c9" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.354576] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b76f7643-3590-4fb0-9845-ac21557501c9',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.488210] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.488482] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.488482] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.488700] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.488700] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.488906] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.489016] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.489081] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.489232] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.489306] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.489389] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0abfe3e-a5d3-4a8d-bdc5-c03daff4976f already deleted. [ 1016.489470] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0abfe3e-a5d3-4a8d-bdc5-c03daff4976f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.508064] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.508512] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.508512] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.508512] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.508714] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.508714] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2e5973c-5504-4cd5-9f92-77ba0193d841 is going to be updated. [ 1016.538062] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.538288] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.538288] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.538469] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.538615] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.547568] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2e5973c-5504-4cd5-9f92-77ba0193d841 in Status: IN_PROGRESS for 2s [ 1016.550480] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9de3df0-a5b4-4be3-a63b-4d4baf532bbc in Status: SUCCESS [ 1016.550679] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.550832] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.551222] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.551459] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.551600] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.551695] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.551881] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.551973] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.552132] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.552317] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.552423] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.552492] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.552647] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.552806] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.552906] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.552996] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.553200] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.553293] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.553386] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.553465] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e9de3df0-a5b4-4be3-a63b-4d4baf532bbc',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.857243] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.857476] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.857604] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.857915] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.858133] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.858299] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Segment Port b76f7643-3590-4fb0-9845-ac21557501c9 not found, creating... [ 1016.858569] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.858729] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.858844] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.859219] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.859363] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.859653] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.859854] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.860294] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.860862] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.861085] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.861241] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Resource: SegmentPort with ID: b76f7643-3590-4fb0-9845-ac21557501c9 is going to be created. [ 1016.890638] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.890856] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.891066] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.891451] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.891957] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.893636] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "port-b76f7643-3590-4fb0-9845-ac21557501c9" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.055885] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e9de3df0-a5b4-4be3-a63b-4d4baf532bbc: rpc.has_security_group_logging(os_id): False [ 1017.075628] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.075931] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.076127] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.076378] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.076766] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.076855] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.076988] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.077123] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.077303] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.077426] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.077845] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.077845] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.077984] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.078178] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.078313] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.078600] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.078898] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.078898] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.079132] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.079267] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.079389] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e9de3df0-a5b4-4be3-a63b-4d4baf532bbc is going to be updated. [ 1017.143835] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.143998] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.144061] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.144384] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.144524] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.167195] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e9de3df0-a5b4-4be3-a63b-4d4baf532bbc in Status: IN_PROGRESS for 2s [ 1017.375405] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ffd44fac-c762-408c-862b-ccea34e00947 in Status: SUCCESS [ 1017.375405] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.430514] env[65065]: INFO networking_nsxv3.common.synchronization [None req-7a4ed4ff-972f-4369-bd4c-91d59e1649f1 None None] Enqueued Resource ID: b9bd34e1-a3f2-4a53-9a82-6188ae5e3b14 with Priority: HIGHEST for action port [ 1017.431527] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9bd34e1-a3f2-4a53-9a82-6188ae5e3b14 with Priority: HIGHEST for action port [ 1017.432361] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-b9bd34e1-a3f2-4a53-9a82-6188ae5e3b14 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.432361] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b9bd34e1-a3f2-4a53-9a82-6188ae5e3b14" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.432361] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b9bd34e1-a3f2-4a53-9a82-6188ae5e3b14" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.432821] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b9bd34e1-a3f2-4a53-9a82-6188ae5e3b14" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.432870] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b9bd34e1-a3f2-4a53-9a82-6188ae5e3b14',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.625455] env[65065]: INFO networking_nsxv3.common.synchronization [req-037025ed-c0b8-4065-955e-7296bdd2b1b5 req-0dfa5610-8e8c-45a5-97ee-1cf2f1792458 service nova] Enqueued Resource ID: d0abfe3e-a5d3-4a8d-bdc5-c03daff4976f with Priority: HIGHEST for action security_group_rules [ 1017.625455] env[65065]: INFO networking_nsxv3.common.synchronization [req-037025ed-c0b8-4065-955e-7296bdd2b1b5 req-0dfa5610-8e8c-45a5-97ee-1cf2f1792458 service nova] Enqueued Resource ID: d0abfe3e-a5d3-4a8d-bdc5-c03daff4976f with Priority: HIGHEST for action security_group_members [ 1017.625827] env[65065]: INFO networking_nsxv3.common.synchronization [req-037025ed-c0b8-4065-955e-7296bdd2b1b5 req-0dfa5610-8e8c-45a5-97ee-1cf2f1792458 service nova] Enqueued Resource ID: b76f7643-3590-4fb0-9845-ac21557501c9 with Priority: HIGHEST for action port [ 1017.628807] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0abfe3e-a5d3-4a8d-bdc5-c03daff4976f with Priority: HIGHEST for action security_group_rules [ 1017.628807] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0abfe3e-a5d3-4a8d-bdc5-c03daff4976f with Priority: HIGHEST for action security_group_members [ 1017.628807] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b76f7643-3590-4fb0-9845-ac21557501c9 with Priority: HIGHEST for action port [ 1017.628807] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d0abfe3e-a5d3-4a8d-bdc5-c03daff4976f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.628807] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d0abfe3e-a5d3-4a8d-bdc5-c03daff4976f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.628807] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d0abfe3e-a5d3-4a8d-bdc5-c03daff4976f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.628807] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d0abfe3e-a5d3-4a8d-bdc5-c03daff4976f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.628807] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d0abfe3e-a5d3-4a8d-bdc5-c03daff4976f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.629967] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0abfe3e-a5d3-4a8d-bdc5-c03daff4976f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.630095] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0abfe3e-a5d3-4a8d-bdc5-c03daff4976f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.630369] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0abfe3e-a5d3-4a8d-bdc5-c03daff4976f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.630540] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0abfe3e-a5d3-4a8d-bdc5-c03daff4976f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.632791] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.632791] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.632791] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.632791] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.632791] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.632791] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d0abfe3e-a5d3-4a8d-bdc5-c03daff4976f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.633744] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-b76f7643-3590-4fb0-9845-ac21557501c9 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.633846] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b76f7643-3590-4fb0-9845-ac21557501c9" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.633910] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b76f7643-3590-4fb0-9845-ac21557501c9" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.634241] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b76f7643-3590-4fb0-9845-ac21557501c9" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.634241] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b76f7643-3590-4fb0-9845-ac21557501c9',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.934937] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b9bd34e1-a3f2-4a53-9a82-6188ae5e3b14 [ 1017.935201] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.935345] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.935421] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.935631] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.935714] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.935808] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b9bd34e1-a3f2-4a53-9a82-6188ae5e3b14 already deleted. [ 1017.935887] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b9bd34e1-a3f2-4a53-9a82-6188ae5e3b14" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.130926] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0abfe3e-a5d3-4a8d-bdc5-c03daff4976f taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.131147] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0abfe3e-a5d3-4a8d-bdc5-c03daff4976f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.134471] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d0abfe3e-a5d3-4a8d-bdc5-c03daff4976f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.136199] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b76f7643-3590-4fb0-9845-ac21557501c9 with status ACTIVE [ 1018.138058] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.138058] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.138058] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.138058] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.138058] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.138058] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.138058] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.138058] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.138058] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.138058] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.138556] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.138556] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.138556] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.138556] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.138556] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.138556] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b76f7643-3590-4fb0-9845-ac21557501c9 is going to be updated. [ 1018.164049] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.164049] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.164049] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.164049] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.164049] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.164544] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b76f7643-3590-4fb0-9845-ac21557501c9" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.558922] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2e5973c-5504-4cd5-9f92-77ba0193d841 in Status: SUCCESS [ 1018.559241] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.560029] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.560029] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.560527] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.560963] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.560963] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.561113] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.561113] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.561217] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.561330] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e2e5973c-5504-4cd5-9f92-77ba0193d841',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.637718] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d0abfe3e-a5d3-4a8d-bdc5-c03daff4976f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.850070] env[65065]: INFO networking_nsxv3.common.synchronization [None req-425da414-0916-4d04-80a7-ee2c71d8c9d4 tempest-ServersV294TestFqdnHostnames-1358533709 tempest-ServersV294TestFqdnHostnames-1358533709-project-member] Enqueued Resource ID: 97377310-5980-4d43-8124-617efecbd7fb with Priority: HIGHEST for action security_group_rules [ 1018.851449] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97377310-5980-4d43-8124-617efecbd7fb with Priority: HIGHEST for action security_group_rules [ 1018.851449] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-97377310-5980-4d43-8124-617efecbd7fb taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.851449] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-97377310-5980-4d43-8124-617efecbd7fb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.851449] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-97377310-5980-4d43-8124-617efecbd7fb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.851449] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-97377310-5980-4d43-8124-617efecbd7fb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.851449] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('97377310-5980-4d43-8124-617efecbd7fb',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.951901] env[65065]: INFO networking_nsxv3.common.synchronization [None req-5f45d602-a79e-4de7-87f1-bb7b47409cb0 tempest-ServersV294TestFqdnHostnames-1358533709 tempest-ServersV294TestFqdnHostnames-1358533709-project-member] Enqueued Resource ID: 97377310-5980-4d43-8124-617efecbd7fb with Priority: HIGHEST for action security_group_rules [ 1018.952504] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97377310-5980-4d43-8124-617efecbd7fb with Priority: HIGHEST for action security_group_rules [ 1018.952808] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-97377310-5980-4d43-8124-617efecbd7fb taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.953172] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-97377310-5980-4d43-8124-617efecbd7fb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.066660] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2e5973c-5504-4cd5-9f92-77ba0193d841 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.066902] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.067165] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.067450] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.067656] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.067790] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.067859] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.068085] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.068200] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.068307] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.068465] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2e5973c-5504-4cd5-9f92-77ba0193d841 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.068569] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.068642] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.068805] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.068974] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.069095] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.069172] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.069332] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.069423] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.069509] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.069618] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e2e5973c-5504-4cd5-9f92-77ba0193d841',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.141724] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.141938] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.141938] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.142646] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.142646] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.142646] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0abfe3e-a5d3-4a8d-bdc5-c03daff4976f is going to be created. [ 1019.170484] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.171088] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.171262] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.171994] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.172176] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.182880] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0abfe3e-a5d3-4a8d-bdc5-c03daff4976f in Status: UNINITIALIZED for 2s [ 1019.189695] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e9de3df0-a5b4-4be3-a63b-4d4baf532bbc in Status: SUCCESS [ 1019.190567] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.190831] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.191105] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.191209] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e9de3df0-a5b4-4be3-a63b-4d4baf532bbc',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.374990] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.374990] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.374990] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.374990] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.375351] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.375351] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 97377310-5980-4d43-8124-617efecbd7fb already deleted. [ 1019.375351] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-97377310-5980-4d43-8124-617efecbd7fb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.375460] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-97377310-5980-4d43-8124-617efecbd7fb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.375627] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-97377310-5980-4d43-8124-617efecbd7fb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.375710] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('97377310-5980-4d43-8124-617efecbd7fb',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.573488] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e2e5973c-5504-4cd5-9f92-77ba0193d841: rpc.has_security_group_logging(os_id): False [ 1019.593494] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.593494] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.593494] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.593494] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.593494] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.593701] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.593701] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.594669] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.594782] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.594825] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.595057] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.595392] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.595392] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.595490] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.595571] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.595769] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.595853] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.595898] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.596049] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.596227] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.596227] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e2e5973c-5504-4cd5-9f92-77ba0193d841 is going to be updated. [ 1019.670027] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.670413] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.670413] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.670576] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.670729] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.685788] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2e5973c-5504-4cd5-9f92-77ba0193d841 in Status: IN_PROGRESS for 2s [ 1019.694440] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.695282] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.695282] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.695282] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.695531] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.696040] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.696040] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.696210] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.696405] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.696405] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.696520] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e9de3df0-a5b4-4be3-a63b-4d4baf532bbc',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.898207] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.898415] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.898464] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.898735] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.898825] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.898922] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 97377310-5980-4d43-8124-617efecbd7fb already deleted. [ 1019.899101] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-97377310-5980-4d43-8124-617efecbd7fb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.988247] env[65065]: INFO networking_nsxv3.common.synchronization [None req-a5e0b9b8-8df8-47cf-9e63-2680858568e9 None None] Enqueued Resource ID: e2b046a6-3019-41f1-a054-f23074fe83b6 with Priority: HIGHEST for action port [ 1019.988782] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2b046a6-3019-41f1-a054-f23074fe83b6 with Priority: HIGHEST for action port [ 1019.989099] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-e2b046a6-3019-41f1-a054-f23074fe83b6 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.989219] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e2b046a6-3019-41f1-a054-f23074fe83b6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.989283] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e2b046a6-3019-41f1-a054-f23074fe83b6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.989532] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e2b046a6-3019-41f1-a054-f23074fe83b6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.989615] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e2b046a6-3019-41f1-a054-f23074fe83b6',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.199832] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.199832] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.199832] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.199832] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.199832] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.200162] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.200162] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.200360] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.200619] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.200619] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.201122] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.201122] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.201326] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.201393] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.201615] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.201797] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.202381] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.202381] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.202381] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.202381] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.202740] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e9de3df0-a5b4-4be3-a63b-4d4baf532bbc',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.300191] env[65065]: INFO networking_nsxv3.common.synchronization [None req-99ed1673-78ce-4337-a3bd-043b578e3a0c tempest-AttachInterfacesTestJSON-1590270829 tempest-AttachInterfacesTestJSON-1590270829-project-member] Enqueued Resource ID: e2e5973c-5504-4cd5-9f92-77ba0193d841 with Priority: HIGHEST for action security_group_members [ 1020.302407] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2e5973c-5504-4cd5-9f92-77ba0193d841 with Priority: HIGHEST for action security_group_members [ 1020.302761] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2e5973c-5504-4cd5-9f92-77ba0193d841 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.302894] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.302968] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.303179] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.303326] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.303581] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.303581] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.303650] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.303690] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.303788] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2e5973c-5504-4cd5-9f92-77ba0193d841',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.491707] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e2b046a6-3019-41f1-a054-f23074fe83b6 [ 1020.491932] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.492088] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.492156] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.492435] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.492522] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.492618] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e2b046a6-3019-41f1-a054-f23074fe83b6 already deleted. [ 1020.492701] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e2b046a6-3019-41f1-a054-f23074fe83b6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.682703] env[65065]: INFO networking_nsxv3.common.synchronization [req-08da021b-15c9-47d2-af9c-fa28a6bc0a31 req-40045c7d-719e-49cc-9f56-fb065fb18265 tempest-ServersTestJSON-1126920631 tempest-ServersTestJSON-1126920631-project-member] Enqueued Resource ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 with Priority: HIGHEST for action security_group_members [ 1020.683353] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 with Priority: HIGHEST for action security_group_members [ 1020.683693] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e5f0086-b1e3-4f00-8207-8306f153d0e4 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.683817] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.684060] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.684182] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.684334] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.684431] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.684497] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.684681] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.684769] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.684861] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e5f0086-b1e3-4f00-8207-8306f153d0e4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.710346] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e9de3df0-a5b4-4be3-a63b-4d4baf532bbc: rpc.has_security_group_logging(os_id): False [ 1020.730769] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.730897] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.730975] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.731224] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.731312] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.731497] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.731588] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.731647] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.731791] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.731864] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.732058] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.732146] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.732207] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.732338] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.732463] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.732591] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.732710] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.732805] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.732898] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.732937] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.733019] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e9de3df0-a5b4-4be3-a63b-4d4baf532bbc is going to be updated. [ 1020.807544] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e2e5973c-5504-4cd5-9f92-77ba0193d841',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.811624] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.811778] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.811778] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.811962] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.812118] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.838044] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e9de3df0-a5b4-4be3-a63b-4d4baf532bbc in Status: IN_PROGRESS for 2s [ 1021.163396] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock network-381 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.163624] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "network-381" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.163749] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "network-381" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.164041] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "network-381" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.164545] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.164770] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.164973] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.165611] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.165611] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.165716] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1021.165817] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1021.165924] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1021.166041] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1021.166151] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1021.166255] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1021.166385] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1021.186388] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1021.186595] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1021.186737] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1021.186910] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "network-381" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.187238] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock port-6950af5c-bb94-4921-a0b6-17dfb11be893 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.187409] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "port-6950af5c-bb94-4921-a0b6-17dfb11be893" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.187526] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "port-6950af5c-bb94-4921-a0b6-17dfb11be893" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.188270] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "port-6950af5c-bb94-4921-a0b6-17dfb11be893" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.188418] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6950af5c-bb94-4921-a0b6-17dfb11be893',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.189346] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1e5f0086-b1e3-4f00-8207-8306f153d0e4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.192588] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0abfe3e-a5d3-4a8d-bdc5-c03daff4976f in Status: SUCCESS [ 1021.192588] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0abfe3e-a5d3-4a8d-bdc5-c03daff4976f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.192588] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0abfe3e-a5d3-4a8d-bdc5-c03daff4976f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.192588] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0abfe3e-a5d3-4a8d-bdc5-c03daff4976f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.192588] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.192794] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.192794] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.192862] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.194039] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.194039] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0abfe3e-a5d3-4a8d-bdc5-c03daff4976f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.194039] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d0abfe3e-a5d3-4a8d-bdc5-c03daff4976f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.314060] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e2e5973c-5504-4cd5-9f92-77ba0193d841',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.460224] env[65065]: INFO networking_nsxv3.common.synchronization [req-08f0a130-524e-47de-b96e-b36a03156c5f req-605335a7-f019-42f9-8588-443ed6a9c5ea tempest-ServersTestMultiNic-1110836678 tempest-ServersTestMultiNic-1110836678-project-member] Enqueued Resource ID: e9de3df0-a5b4-4be3-a63b-4d4baf532bbc with Priority: HIGHEST for action security_group_members [ 1021.460906] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9de3df0-a5b4-4be3-a63b-4d4baf532bbc with Priority: HIGHEST for action security_group_members [ 1021.461429] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.461576] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.461646] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.461846] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.462022] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.462138] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.462212] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.462409] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.462499] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.462593] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e9de3df0-a5b4-4be3-a63b-4d4baf532bbc',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.691704] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.692062] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.692062] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.692320] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.692429] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.692582] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Segment Port 6950af5c-bb94-4921-a0b6-17dfb11be893 not found, creating... [ 1021.692839] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.692995] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.693163] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.693386] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.693529] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.693811] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.693965] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.694102] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.694307] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.694437] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.694573] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Resource: SegmentPort with ID: 6950af5c-bb94-4921-a0b6-17dfb11be893 is going to be created. [ 1021.695596] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1e5f0086-b1e3-4f00-8207-8306f153d0e4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.696463] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d0abfe3e-a5d3-4a8d-bdc5-c03daff4976f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.698668] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2e5973c-5504-4cd5-9f92-77ba0193d841 in Status: SUCCESS [ 1021.698853] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.714985] env[65065]: INFO networking_nsxv3.common.synchronization [req-08f0a130-524e-47de-b96e-b36a03156c5f req-a94236f2-5632-4dbe-a724-e64d56523ab6 tempest-ServersTestMultiNic-1110836678 tempest-ServersTestMultiNic-1110836678-project-member] Enqueued Resource ID: e9de3df0-a5b4-4be3-a63b-4d4baf532bbc with Priority: HIGHEST for action security_group_members [ 1021.716372] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9de3df0-a5b4-4be3-a63b-4d4baf532bbc with Priority: HIGHEST for action security_group_members [ 1021.717396] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.717625] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.717776] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.718048] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.718237] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.718451] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "port-6950af5c-bb94-4921-a0b6-17dfb11be893" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.719221] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.719305] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.816875] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.817064] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.817119] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.817353] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.817444] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.817545] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2e5973c-5504-4cd5-9f92-77ba0193d841 is going to be updated. [ 1021.862770] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.862964] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.863022] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.863212] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.863367] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.876194] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2e5973c-5504-4cd5-9f92-77ba0193d841 in Status: IN_PROGRESS for 2s [ 1021.964757] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e9de3df0-a5b4-4be3-a63b-4d4baf532bbc',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.199080] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.199738] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.199831] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.202704] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.202704] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.202704] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 is going to be updated. [ 1022.202704] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d0abfe3e-a5d3-4a8d-bdc5-c03daff4976f: rpc.has_security_group_logging(os_id): False [ 1022.224896] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.225125] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.225125] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.225332] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.225415] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.225656] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.225752] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.225813] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.225960] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.226058] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.226144] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d0abfe3e-a5d3-4a8d-bdc5-c03daff4976f is going to be created. [ 1022.241219] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.242436] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.242568] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.242875] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.243040] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.254386] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 in Status: IN_PROGRESS for 2s [ 1022.306537] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.306819] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.306894] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.307152] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.307358] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.320239] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d0abfe3e-a5d3-4a8d-bdc5-c03daff4976f in Status: IN_PROGRESS for 2s [ 1022.435154] env[65065]: INFO networking_nsxv3.common.synchronization [req-08da021b-15c9-47d2-af9c-fa28a6bc0a31 req-1e79399f-9f08-4812-8559-dcefaa17e1c4 service nova] Enqueued Resource ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 with Priority: HIGHEST for action security_group_rules [ 1022.435346] env[65065]: INFO networking_nsxv3.common.synchronization [req-08da021b-15c9-47d2-af9c-fa28a6bc0a31 req-1e79399f-9f08-4812-8559-dcefaa17e1c4 service nova] Enqueued Resource ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 with Priority: HIGHEST for action security_group_members [ 1022.435484] env[65065]: INFO networking_nsxv3.common.synchronization [req-08da021b-15c9-47d2-af9c-fa28a6bc0a31 req-1e79399f-9f08-4812-8559-dcefaa17e1c4 service nova] Enqueued Resource ID: 6950af5c-bb94-4921-a0b6-17dfb11be893 with Priority: HIGHEST for action port [ 1022.436356] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 with Priority: HIGHEST for action security_group_rules [ 1022.436501] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 with Priority: HIGHEST for action security_group_members [ 1022.436676] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6950af5c-bb94-4921-a0b6-17dfb11be893 with Priority: HIGHEST for action port [ 1022.438127] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1e5f0086-b1e3-4f00-8207-8306f153d0e4 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.438297] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.438394] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.438631] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.438754] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1e5f0086-b1e3-4f00-8207-8306f153d0e4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.439676] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e5f0086-b1e3-4f00-8207-8306f153d0e4 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.439936] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.440262] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-6950af5c-bb94-4921-a0b6-17dfb11be893 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.440406] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6950af5c-bb94-4921-a0b6-17dfb11be893" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.440573] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6950af5c-bb94-4921-a0b6-17dfb11be893" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.441070] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6950af5c-bb94-4921-a0b6-17dfb11be893" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.441199] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6950af5c-bb94-4921-a0b6-17dfb11be893',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.467479] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e9de3df0-a5b4-4be3-a63b-4d4baf532bbc',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.851561] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e9de3df0-a5b4-4be3-a63b-4d4baf532bbc in Status: SUCCESS [ 1022.851980] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.943538] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e5f0086-b1e3-4f00-8207-8306f153d0e4 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.943688] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.943908] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6950af5c-bb94-4921-a0b6-17dfb11be893 with status ACTIVE [ 1022.944163] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.944281] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.944351] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.944617] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.944739] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.944918] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.945035] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.945129] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.945309] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.945393] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.946178] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.946178] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.946178] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.946178] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.946178] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.946450] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6950af5c-bb94-4921-a0b6-17dfb11be893 is going to be updated. [ 1022.969176] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.969391] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.969436] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.969628] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.969812] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.970070] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6950af5c-bb94-4921-a0b6-17dfb11be893" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.970595] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.970595] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.970595] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.970778] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.970876] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.970929] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e9de3df0-a5b4-4be3-a63b-4d4baf532bbc is going to be updated. [ 1023.000674] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.000897] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.000897] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.001091] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.001295] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.012116] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9de3df0-a5b4-4be3-a63b-4d4baf532bbc in Status: IN_PROGRESS for 2s [ 1023.257230] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock network-688 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.257397] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "network-688" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.257630] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "network-688" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.257732] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "network-688" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.257977] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.258188] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.258386] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.258614] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.258751] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.258949] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1023.259068] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1023.259176] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1023.259354] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1023.259462] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1023.259567] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1023.259745] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1023.283376] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1023.283845] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1023.284089] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1023.284321] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "network-688" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.284941] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock port-e66d42f1-e22e-49b5-9025-8ee5952cbbcd taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.285207] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "port-e66d42f1-e22e-49b5-9025-8ee5952cbbcd" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.285424] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "port-e66d42f1-e22e-49b5-9025-8ee5952cbbcd" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.285945] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "port-e66d42f1-e22e-49b5-9025-8ee5952cbbcd" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.286167] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e66d42f1-e22e-49b5-9025-8ee5952cbbcd',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.788326] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.788609] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.788778] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.789159] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.789340] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.789524] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Segment Port e66d42f1-e22e-49b5-9025-8ee5952cbbcd not found, creating... [ 1023.789815] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.790036] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.790230] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.790464] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.790603] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.790890] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.791102] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.791229] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.791435] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.791566] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.791702] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Resource: SegmentPort with ID: e66d42f1-e22e-49b5-9025-8ee5952cbbcd is going to be created. [ 1023.817356] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.817563] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.817685] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.817971] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.818243] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.818479] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "port-e66d42f1-e22e-49b5-9025-8ee5952cbbcd" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.898127] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2e5973c-5504-4cd5-9f92-77ba0193d841 in Status: SUCCESS [ 1023.898420] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.265593] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 in Status: SUCCESS [ 1024.265593] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.265593] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.265593] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.265837] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.265890] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.265961] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.266129] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.266238] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.266302] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e5f0086-b1e3-4f00-8207-8306f153d0e4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.336879] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d0abfe3e-a5d3-4a8d-bdc5-c03daff4976f in Status: SUCCESS [ 1024.336879] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d0abfe3e-a5d3-4a8d-bdc5-c03daff4976f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.537320] env[65065]: INFO networking_nsxv3.common.synchronization [req-1505ed75-c114-4089-b816-c8791af1bd03 req-3af1ff80-6836-456a-aed7-ddb9ffccf65a service nova] Enqueued Resource ID: e2e5973c-5504-4cd5-9f92-77ba0193d841 with Priority: HIGHEST for action security_group_rules [ 1024.537536] env[65065]: INFO networking_nsxv3.common.synchronization [req-1505ed75-c114-4089-b816-c8791af1bd03 req-3af1ff80-6836-456a-aed7-ddb9ffccf65a service nova] Enqueued Resource ID: e2e5973c-5504-4cd5-9f92-77ba0193d841 with Priority: HIGHEST for action security_group_members [ 1024.537684] env[65065]: INFO networking_nsxv3.common.synchronization [req-1505ed75-c114-4089-b816-c8791af1bd03 req-3af1ff80-6836-456a-aed7-ddb9ffccf65a service nova] Enqueued Resource ID: e66d42f1-e22e-49b5-9025-8ee5952cbbcd with Priority: HIGHEST for action port [ 1024.538370] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2e5973c-5504-4cd5-9f92-77ba0193d841 with Priority: HIGHEST for action security_group_rules [ 1024.539110] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2e5973c-5504-4cd5-9f92-77ba0193d841 with Priority: HIGHEST for action security_group_members [ 1024.539110] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e66d42f1-e22e-49b5-9025-8ee5952cbbcd with Priority: HIGHEST for action port [ 1024.539110] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e2e5973c-5504-4cd5-9f92-77ba0193d841 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.539110] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.539110] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.539381] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.539381] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e2e5973c-5504-4cd5-9f92-77ba0193d841',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.540353] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2e5973c-5504-4cd5-9f92-77ba0193d841 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.540482] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.540571] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.540749] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.540948] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.541066] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.541144] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.541273] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.541358] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.541450] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2e5973c-5504-4cd5-9f92-77ba0193d841',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.543354] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-e66d42f1-e22e-49b5-9025-8ee5952cbbcd taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.543354] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e66d42f1-e22e-49b5-9025-8ee5952cbbcd" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.543354] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e66d42f1-e22e-49b5-9025-8ee5952cbbcd" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.543354] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e66d42f1-e22e-49b5-9025-8ee5952cbbcd" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.543354] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e66d42f1-e22e-49b5-9025-8ee5952cbbcd',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.768980] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1e5f0086-b1e3-4f00-8207-8306f153d0e4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.023310] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9de3df0-a5b4-4be3-a63b-4d4baf532bbc in Status: SUCCESS [ 1025.023595] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.023801] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.024093] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.024315] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.024474] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.024609] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.024803] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.024904] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.025031] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e9de3df0-a5b4-4be3-a63b-4d4baf532bbc',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.044532] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2e5973c-5504-4cd5-9f92-77ba0193d841 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.044700] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.044822] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e2e5973c-5504-4cd5-9f92-77ba0193d841',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.046047] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e66d42f1-e22e-49b5-9025-8ee5952cbbcd with status ACTIVE [ 1025.046233] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.046348] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.046425] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.046620] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.046701] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.046942] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.047061] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.047061] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.048012] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.048012] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.048012] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.048012] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.048012] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.048012] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.048012] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.048012] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e66d42f1-e22e-49b5-9025-8ee5952cbbcd is going to be updated. [ 1025.071395] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.071566] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.071680] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.072011] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.072244] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.072613] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e66d42f1-e22e-49b5-9025-8ee5952cbbcd" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.273881] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1e5f0086-b1e3-4f00-8207-8306f153d0e4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.369309] env[65065]: INFO networking_nsxv3.common.synchronization [req-d53bd2b3-814b-423c-afd0-bd278569ecf0 req-1a40b2d2-c222-49d9-9b7a-ff13f9913720 tempest-DeleteServersTestJSON-1316666736 tempest-DeleteServersTestJSON-1316666736-project-member] Enqueued Resource ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 with Priority: HIGHEST for action security_group_members [ 1025.370211] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 with Priority: HIGHEST for action security_group_members [ 1025.370492] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d0941d4-57d8-45e9-9f2f-95128b8136e5 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.370610] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.370709] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.371347] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.371503] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.371605] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.371678] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.372356] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.372505] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.372616] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d0941d4-57d8-45e9-9f2f-95128b8136e5',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.527168] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.527331] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.527384] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.527596] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.527717] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.527956] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.527956] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.528129] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.528172] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.528236] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.528314] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e9de3df0-a5b4-4be3-a63b-4d4baf532bbc is going to be updated. [ 1025.547252] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e2e5973c-5504-4cd5-9f92-77ba0193d841',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.559752] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.559752] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.559752] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.560068] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.560119] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.569433] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9de3df0-a5b4-4be3-a63b-4d4baf532bbc in Status: IN_PROGRESS for 2s [ 1025.746284] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock network-950 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.746453] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "network-950" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.746578] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "network-950" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.746845] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "network-950" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.747117] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.747273] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.747455] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.747606] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.747750] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.747959] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1025.748126] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1025.748252] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1025.748359] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1025.748470] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1025.748573] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1025.748702] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1025.767854] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1025.768069] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1025.768248] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1025.768424] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "network-950" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.768733] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock port-dd66255f-3df0-4495-9f26-018bf5e6cbea taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.768891] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "port-dd66255f-3df0-4495-9f26-018bf5e6cbea" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.769015] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "port-dd66255f-3df0-4495-9f26-018bf5e6cbea" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.769339] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "port-dd66255f-3df0-4495-9f26-018bf5e6cbea" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.769475] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dd66255f-3df0-4495-9f26-018bf5e6cbea',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.776438] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.776600] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.776666] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.776817] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.776978] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.776978] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 is going to be updated. [ 1025.803995] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.804175] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.805018] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.805018] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.805018] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.815012] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 in Status: IN_PROGRESS for 2s [ 1025.874444] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.874607] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.874679] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.874908] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.875017] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.875336] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.875449] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.875514] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.875684] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.875765] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.875853] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 is going to be updated. [ 1025.902806] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.902998] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.902998] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.903238] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.903376] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.912914] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 in Status: IN_PROGRESS for 2s [ 1026.053420] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.053420] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.053420] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.054997] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.054997] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.054997] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2e5973c-5504-4cd5-9f92-77ba0193d841 is going to be updated. [ 1026.079908] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.080141] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.080363] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.080685] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.080925] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.090805] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2e5973c-5504-4cd5-9f92-77ba0193d841 in Status: IN_PROGRESS for 2s [ 1026.272590] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.272840] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.273019] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.273334] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.273483] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.273667] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Segment Port dd66255f-3df0-4495-9f26-018bf5e6cbea not found, creating... [ 1026.273955] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.274128] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.274242] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.274492] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.274748] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.275041] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.275320] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.275492] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.275718] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.275899] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.276091] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Resource: SegmentPort with ID: dd66255f-3df0-4495-9f26-018bf5e6cbea is going to be created. [ 1026.295056] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.295386] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.295386] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.295642] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.295872] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.296120] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "port-dd66255f-3df0-4495-9f26-018bf5e6cbea" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.582130] env[65065]: INFO networking_nsxv3.common.synchronization [req-e11f6e88-d7b0-4d7e-8213-fae2aa3433eb req-48089cfe-4660-4c72-bfc1-c0136b514cb1 tempest-ServerDiskConfigTestJSON-975440465 tempest-ServerDiskConfigTestJSON-975440465-project-member] Enqueued Resource ID: ffd44fac-c762-408c-862b-ccea34e00947 with Priority: HIGHEST for action security_group_members [ 1026.582860] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ffd44fac-c762-408c-862b-ccea34e00947 with Priority: HIGHEST for action security_group_members [ 1026.583803] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-ffd44fac-c762-408c-862b-ccea34e00947 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.583932] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.584095] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.584293] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.584415] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.584517] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.584588] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.584746] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.584844] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.584948] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ffd44fac-c762-408c-862b-ccea34e00947',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.027787] env[65065]: INFO networking_nsxv3.common.synchronization [req-d53bd2b3-814b-423c-afd0-bd278569ecf0 req-28d48829-74de-49a3-9022-0786b4d2e58b service nova] Enqueued Resource ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 with Priority: HIGHEST for action security_group_rules [ 1027.027946] env[65065]: INFO networking_nsxv3.common.synchronization [req-d53bd2b3-814b-423c-afd0-bd278569ecf0 req-28d48829-74de-49a3-9022-0786b4d2e58b service nova] Enqueued Resource ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 with Priority: HIGHEST for action security_group_members [ 1027.028122] env[65065]: INFO networking_nsxv3.common.synchronization [req-d53bd2b3-814b-423c-afd0-bd278569ecf0 req-28d48829-74de-49a3-9022-0786b4d2e58b service nova] Enqueued Resource ID: dd66255f-3df0-4495-9f26-018bf5e6cbea with Priority: HIGHEST for action port [ 1027.028690] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 with Priority: HIGHEST for action security_group_rules [ 1027.028836] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 with Priority: HIGHEST for action security_group_members [ 1027.028918] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd66255f-3df0-4495-9f26-018bf5e6cbea with Priority: HIGHEST for action port [ 1027.029705] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7d0941d4-57d8-45e9-9f2f-95128b8136e5 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.029838] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.029906] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.030159] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.030259] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7d0941d4-57d8-45e9-9f2f-95128b8136e5',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.031165] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d0941d4-57d8-45e9-9f2f-95128b8136e5 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.031320] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.031471] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-dd66255f-3df0-4495-9f26-018bf5e6cbea taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.031623] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dd66255f-3df0-4495-9f26-018bf5e6cbea" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.031704] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dd66255f-3df0-4495-9f26-018bf5e6cbea" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.032032] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dd66255f-3df0-4495-9f26-018bf5e6cbea" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.032032] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dd66255f-3df0-4495-9f26-018bf5e6cbea',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.087066] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.087455] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.087455] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.087585] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.087693] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.087933] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.088069] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.088146] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.088342] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.088585] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.088585] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ffd44fac-c762-408c-862b-ccea34e00947 is going to be updated. [ 1027.120052] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.120308] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.120308] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.120523] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.120659] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.132943] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ffd44fac-c762-408c-862b-ccea34e00947 in Status: IN_PROGRESS for 2s [ 1027.537267] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d0941d4-57d8-45e9-9f2f-95128b8136e5 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.537267] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.537267] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dd66255f-3df0-4495-9f26-018bf5e6cbea with status ACTIVE [ 1027.537267] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.537267] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.537267] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.537267] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.537267] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.537267] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.537267] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.537267] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.537267] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.537267] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.537267] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.537995] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.537995] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.537995] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.537995] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.538465] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dd66255f-3df0-4495-9f26-018bf5e6cbea is going to be updated. [ 1027.565815] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.568174] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.568174] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.568174] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.568174] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.568174] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dd66255f-3df0-4495-9f26-018bf5e6cbea" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.581283] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9de3df0-a5b4-4be3-a63b-4d4baf532bbc in Status: SUCCESS [ 1027.582168] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e9de3df0-a5b4-4be3-a63b-4d4baf532bbc deletion is rescheduled due to dependency. [ 1027.585421] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.824938] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 in Status: SUCCESS [ 1027.825304] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.825373] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.825563] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.825794] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.825918] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.825983] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.826150] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.826231] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.826316] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.826408] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1e5f0086-b1e3-4f00-8207-8306f153d0e4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.893827] env[65065]: INFO networking_nsxv3.common.synchronization [req-cacd01d7-366f-40ea-b86d-96bb4b4ea3d1 req-db8d9f99-e63b-4b9d-b8bc-34504051cb71 tempest-ServersV294TestFqdnHostnames-1358533709 tempest-ServersV294TestFqdnHostnames-1358533709-project-member] Enqueued Resource ID: 97377310-5980-4d43-8124-617efecbd7fb with Priority: HIGHEST for action security_group_members [ 1027.894416] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97377310-5980-4d43-8124-617efecbd7fb with Priority: HIGHEST for action security_group_members [ 1027.894854] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-97377310-5980-4d43-8124-617efecbd7fb taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.894982] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-97377310-5980-4d43-8124-617efecbd7fb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.895066] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-97377310-5980-4d43-8124-617efecbd7fb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.895491] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-97377310-5980-4d43-8124-617efecbd7fb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.895654] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.895749] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.895814] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.895997] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.896112] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.896214] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('97377310-5980-4d43-8124-617efecbd7fb',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.923328] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 in Status: SUCCESS [ 1027.923328] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 deletion is rescheduled due to dependency. [ 1027.923539] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.923631] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.924158] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.924158] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.924158] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.924369] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.924436] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.925568] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.925568] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d0941d4-57d8-45e9-9f2f-95128b8136e5',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.108305] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2e5973c-5504-4cd5-9f92-77ba0193d841 in Status: SUCCESS [ 1028.108305] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.108305] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.108719] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.108719] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.108816] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.108816] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.108999] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.109131] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.109270] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.109371] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e2e5973c-5504-4cd5-9f92-77ba0193d841',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.242422] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock network-701 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.242697] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "network-701" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.242827] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "network-701" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.243196] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "network-701" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.243465] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.243622] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.243737] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.243955] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.244107] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.244339] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1028.244490] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1028.244644] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1028.244765] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1028.244884] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1028.244991] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1028.245169] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1028.266909] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1028.267353] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1028.267353] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1028.267799] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "network-701" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.267799] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock port-8804191f-62b8-4531-848a-3139a5473461 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.268587] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "port-8804191f-62b8-4531-848a-3139a5473461" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.268587] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "port-8804191f-62b8-4531-848a-3139a5473461" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.268587] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "port-8804191f-62b8-4531-848a-3139a5473461" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.268587] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8804191f-62b8-4531-848a-3139a5473461',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.330046] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e5f0086-b1e3-4f00-8207-8306f153d0e4 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.330386] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.330536] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.330673] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.330865] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.330987] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.331105] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.331262] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.331403] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.331519] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.331691] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e5f0086-b1e3-4f00-8207-8306f153d0e4 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.332193] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.332193] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.332193] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.332193] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.332482] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.332482] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.332564] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.332700] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.332700] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.332841] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1e5f0086-b1e3-4f00-8207-8306f153d0e4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.399685] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.399899] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.400012] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.400358] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.400477] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.400753] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.400895] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.400989] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.401264] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.401386] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.401510] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 97377310-5980-4d43-8124-617efecbd7fb already deleted. [ 1028.401630] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-97377310-5980-4d43-8124-617efecbd7fb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.428867] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7d0941d4-57d8-45e9-9f2f-95128b8136e5',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.611666] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2e5973c-5504-4cd5-9f92-77ba0193d841 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.611919] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.611919] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.612116] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.612281] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.612376] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.612449] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.612608] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.612684] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.612768] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.613285] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2e5973c-5504-4cd5-9f92-77ba0193d841 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.613285] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.613285] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.613285] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.613561] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.613561] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.613561] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.613698] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.613698] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.613762] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.613837] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e2e5973c-5504-4cd5-9f92-77ba0193d841',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.772630] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.772823] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.772960] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.773250] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.773682] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.773682] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Segment Port 8804191f-62b8-4531-848a-3139a5473461 not found, creating... [ 1028.773793] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.773948] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.774318] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.774318] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.774415] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.774909] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.774909] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.775068] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.775198] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.775295] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.775433] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Resource: SegmentPort with ID: 8804191f-62b8-4531-848a-3139a5473461 is going to be created. [ 1028.799326] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.799559] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.799684] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.799986] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.800332] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.800595] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "port-8804191f-62b8-4531-848a-3139a5473461" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.838067] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1e5f0086-b1e3-4f00-8207-8306f153d0e4: rpc.has_security_group_logging(os_id): False [ 1028.855606] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.855762] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.855821] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.856053] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.856149] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.856387] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.856493] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.856550] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.856710] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.856788] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.856960] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.857066] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.857129] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.857306] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.857382] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.857588] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.857681] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.857741] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.857903] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.857978] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.858078] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 is going to be updated. [ 1028.930405] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7d0941d4-57d8-45e9-9f2f-95128b8136e5',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.971462] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.971763] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.971834] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.972136] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.972369] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.992577] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 in Status: IN_PROGRESS for 2s [ 1029.117026] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e2e5973c-5504-4cd5-9f92-77ba0193d841: rpc.has_security_group_logging(os_id): False [ 1029.136856] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.136856] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.136856] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.136856] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.136856] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.136856] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.137624] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.137765] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.137953] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.138085] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.138323] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.138447] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.138528] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.138777] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.138777] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.138996] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.139233] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.139460] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.139460] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.139610] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.139840] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e2e5973c-5504-4cd5-9f92-77ba0193d841 is going to be updated. [ 1029.157620] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ffd44fac-c762-408c-862b-ccea34e00947 in Status: SUCCESS [ 1029.157923] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ffd44fac-c762-408c-862b-ccea34e00947 deletion is rescheduled due to dependency. [ 1029.158122] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.212465] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.212615] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.212685] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.212897] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.213057] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.227454] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2e5973c-5504-4cd5-9f92-77ba0193d841 in Status: IN_PROGRESS for 2s [ 1029.432730] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.432938] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.433031] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.433353] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.433441] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.433611] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 is going to be updated. [ 1029.465621] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.465803] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.465889] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.467048] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.467048] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.478253] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 in Status: IN_PROGRESS for 2s [ 1029.529769] env[65065]: INFO networking_nsxv3.common.synchronization [req-cacd01d7-366f-40ea-b86d-96bb4b4ea3d1 req-7ec3f5ae-c836-4ad7-abe0-1375c1aafd7e service nova] Enqueued Resource ID: 97377310-5980-4d43-8124-617efecbd7fb with Priority: HIGHEST for action security_group_rules [ 1029.529769] env[65065]: INFO networking_nsxv3.common.synchronization [req-cacd01d7-366f-40ea-b86d-96bb4b4ea3d1 req-7ec3f5ae-c836-4ad7-abe0-1375c1aafd7e service nova] Enqueued Resource ID: 97377310-5980-4d43-8124-617efecbd7fb with Priority: HIGHEST for action security_group_members [ 1029.529769] env[65065]: INFO networking_nsxv3.common.synchronization [req-cacd01d7-366f-40ea-b86d-96bb4b4ea3d1 req-7ec3f5ae-c836-4ad7-abe0-1375c1aafd7e service nova] Enqueued Resource ID: 8804191f-62b8-4531-848a-3139a5473461 with Priority: HIGHEST for action port [ 1029.529769] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97377310-5980-4d43-8124-617efecbd7fb with Priority: HIGHEST for action security_group_rules [ 1029.530642] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97377310-5980-4d43-8124-617efecbd7fb with Priority: HIGHEST for action security_group_members [ 1029.531043] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8804191f-62b8-4531-848a-3139a5473461 with Priority: HIGHEST for action port [ 1029.534548] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-97377310-5980-4d43-8124-617efecbd7fb taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.534548] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-97377310-5980-4d43-8124-617efecbd7fb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.534548] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-97377310-5980-4d43-8124-617efecbd7fb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.534548] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-97377310-5980-4d43-8124-617efecbd7fb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.534548] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('97377310-5980-4d43-8124-617efecbd7fb',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.534548] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-97377310-5980-4d43-8124-617efecbd7fb taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.534548] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-97377310-5980-4d43-8124-617efecbd7fb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.534548] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-97377310-5980-4d43-8124-617efecbd7fb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.534548] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-97377310-5980-4d43-8124-617efecbd7fb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.534548] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.534548] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.534548] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.534548] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.534548] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.534548] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('97377310-5980-4d43-8124-617efecbd7fb',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.538601] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-8804191f-62b8-4531-848a-3139a5473461 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.538601] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8804191f-62b8-4531-848a-3139a5473461" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.538601] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8804191f-62b8-4531-848a-3139a5473461" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.538601] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8804191f-62b8-4531-848a-3139a5473461" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.538601] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8804191f-62b8-4531-848a-3139a5473461',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.040140] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8804191f-62b8-4531-848a-3139a5473461 with status ACTIVE [ 1030.040517] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.040649] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.040727] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.040936] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.041035] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.041244] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.041464] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.041558] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.041724] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.041805] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.042011] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.042107] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.042168] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.042327] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.042413] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.042527] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8804191f-62b8-4531-848a-3139a5473461 is going to be updated. [ 1030.043812] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('97377310-5980-4d43-8124-617efecbd7fb',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.045029] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-97377310-5980-4d43-8124-617efecbd7fb taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.045138] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-97377310-5980-4d43-8124-617efecbd7fb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.067139] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.067286] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.067362] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.067936] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.067936] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.067936] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8804191f-62b8-4531-848a-3139a5473461" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.448389] env[65065]: INFO networking_nsxv3.common.synchronization [req-93b28a31-8fd2-4513-a900-560b066be998 req-61795d13-d86c-4136-88e8-10ac6f4232c3 tempest-ServersNegativeTestJSON-1748204548 tempest-ServersNegativeTestJSON-1748204548-project-member] Enqueued Resource ID: a793cfdd-5070-4bec-85b3-ff10a26c966f with Priority: HIGHEST for action security_group_members [ 1030.448389] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a793cfdd-5070-4bec-85b3-ff10a26c966f with Priority: HIGHEST for action security_group_members [ 1030.448389] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-a793cfdd-5070-4bec-85b3-ff10a26c966f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.448389] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a793cfdd-5070-4bec-85b3-ff10a26c966f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.448389] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a793cfdd-5070-4bec-85b3-ff10a26c966f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.448389] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a793cfdd-5070-4bec-85b3-ff10a26c966f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.449101] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.449341] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.449488] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.449935] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.450171] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.450396] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a793cfdd-5070-4bec-85b3-ff10a26c966f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.546786] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('97377310-5980-4d43-8124-617efecbd7fb',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.954136] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.955050] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.955050] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.955050] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.955050] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.955252] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.955309] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.955981] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.955981] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.955981] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.955981] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a793cfdd-5070-4bec-85b3-ff10a26c966f is going to be updated. [ 1030.984758] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.984938] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.985161] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.985437] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.985481] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.999381] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a793cfdd-5070-4bec-85b3-ff10a26c966f in Status: IN_PROGRESS for 2s [ 1031.007839] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 in Status: SUCCESS [ 1031.007839] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.049470] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.049648] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.049720] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.049939] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.050045] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.050168] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 97377310-5980-4d43-8124-617efecbd7fb is going to be created. [ 1031.077697] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.077877] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.077949] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.078248] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.078538] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.089911] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 97377310-5980-4d43-8124-617efecbd7fb in Status: UNINITIALIZED for 2s [ 1031.241812] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2e5973c-5504-4cd5-9f92-77ba0193d841 in Status: SUCCESS [ 1031.241958] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.486755] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 in Status: SUCCESS [ 1031.487036] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.487173] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.487384] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.487685] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.487685] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.487837] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.487876] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.487956] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.488097] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.488425] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7d0941d4-57d8-45e9-9f2f-95128b8136e5',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.990869] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d0941d4-57d8-45e9-9f2f-95128b8136e5 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.991078] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.991164] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.991431] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.991615] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.991724] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.991791] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.992643] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.992643] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.992643] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.992643] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d0941d4-57d8-45e9-9f2f-95128b8136e5 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.992643] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.992643] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.992643] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.993108] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.993108] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.993108] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.993108] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.993259] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.993259] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.993325] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7d0941d4-57d8-45e9-9f2f-95128b8136e5',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.498426] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7d0941d4-57d8-45e9-9f2f-95128b8136e5: rpc.has_security_group_logging(os_id): False [ 1032.518810] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.522669] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.522669] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.522669] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.523168] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.523436] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.523562] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.523627] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.523791] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.523873] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.524092] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.524191] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.524257] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.524395] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.524467] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.524638] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.524728] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.524786] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.524921] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.524995] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.525424] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 is going to be updated. [ 1032.590566] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.590732] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.590820] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.591139] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.591373] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.607228] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 in Status: IN_PROGRESS for 2s [ 1033.012316] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a793cfdd-5070-4bec-85b3-ff10a26c966f in Status: SUCCESS [ 1033.012516] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a793cfdd-5070-4bec-85b3-ff10a26c966f deletion is rescheduled due to dependency. [ 1033.012560] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a793cfdd-5070-4bec-85b3-ff10a26c966f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.101326] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 97377310-5980-4d43-8124-617efecbd7fb in Status: SUCCESS [ 1033.101455] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-97377310-5980-4d43-8124-617efecbd7fb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.101928] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-97377310-5980-4d43-8124-617efecbd7fb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.101928] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-97377310-5980-4d43-8124-617efecbd7fb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.102126] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.102126] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.102126] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.102905] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.102905] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.102905] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-97377310-5980-4d43-8124-617efecbd7fb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.102905] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('97377310-5980-4d43-8124-617efecbd7fb',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.606513] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('97377310-5980-4d43-8124-617efecbd7fb',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.109957] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 97377310-5980-4d43-8124-617efecbd7fb: rpc.has_security_group_logging(os_id): False [ 1034.129881] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.130104] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.130150] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.130434] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.130522] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.130760] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.130876] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.130927] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.131071] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.131142] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.131223] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 97377310-5980-4d43-8124-617efecbd7fb is going to be created. [ 1034.196904] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.197223] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.197223] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.197542] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.197812] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.213185] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 97377310-5980-4d43-8124-617efecbd7fb in Status: IN_PROGRESS for 2s [ 1034.622628] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 in Status: SUCCESS [ 1034.622960] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.781794] env[65065]: INFO networking_nsxv3.common.synchronization [req-1a6a5fa9-8162-4d0d-b850-ebc593c84f05 req-d8b48712-f1fa-4a1c-8d41-7555ac338228 tempest-ServerActionsTestOtherA-78922671 tempest-ServerActionsTestOtherA-78922671-project-member] Enqueued Resource ID: 42051b03-8b5b-4d44-b3bc-8b87353afdd7 with Priority: HIGHEST for action security_group_members [ 1034.782419] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42051b03-8b5b-4d44-b3bc-8b87353afdd7 with Priority: HIGHEST for action security_group_members [ 1034.782665] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-42051b03-8b5b-4d44-b3bc-8b87353afdd7 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.782780] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-42051b03-8b5b-4d44-b3bc-8b87353afdd7" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.782992] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-42051b03-8b5b-4d44-b3bc-8b87353afdd7" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.783262] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-42051b03-8b5b-4d44-b3bc-8b87353afdd7" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.783428] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.783532] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.783594] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.783768] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.783829] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.783921] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('42051b03-8b5b-4d44-b3bc-8b87353afdd7',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.182391] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock network-33 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.182586] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "network-33" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.182705] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "network-33" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.182972] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "network-33" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.183239] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.183400] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.183628] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.183712] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.183849] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.184064] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1035.184179] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1035.184288] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1035.184396] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1035.184541] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1035.184649] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1035.184853] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1035.205981] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1035.205981] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1035.205981] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1035.206243] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "network-33" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.206592] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock port-642b3e8f-ce2f-4a83-b490-79f4c306f5cd taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.206781] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "port-642b3e8f-ce2f-4a83-b490-79f4c306f5cd" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.206890] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "port-642b3e8f-ce2f-4a83-b490-79f4c306f5cd" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.207229] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "port-642b3e8f-ce2f-4a83-b490-79f4c306f5cd" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.207374] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('642b3e8f-ce2f-4a83-b490-79f4c306f5cd',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.286428] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.286628] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.286710] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.286981] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.287103] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.287308] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.287397] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.287465] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.287613] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.287687] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.287766] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 42051b03-8b5b-4d44-b3bc-8b87353afdd7 already deleted. [ 1035.287844] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-42051b03-8b5b-4d44-b3bc-8b87353afdd7" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.712762] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.713127] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.713214] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.713488] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.713639] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.713797] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Segment Port 642b3e8f-ce2f-4a83-b490-79f4c306f5cd not found, creating... [ 1035.714073] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.714289] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.714351] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.714671] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.714765] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.715120] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.715310] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.715438] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.715826] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.715826] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.715975] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Resource: SegmentPort with ID: 642b3e8f-ce2f-4a83-b490-79f4c306f5cd is going to be created. [ 1035.736584] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.736792] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.736920] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.737230] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.737463] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.737718] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "port-642b3e8f-ce2f-4a83-b490-79f4c306f5cd" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.225615] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 97377310-5980-4d43-8124-617efecbd7fb in Status: SUCCESS [ 1036.225749] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-97377310-5980-4d43-8124-617efecbd7fb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.429596] env[65065]: INFO networking_nsxv3.common.synchronization [req-1a6a5fa9-8162-4d0d-b850-ebc593c84f05 req-2578305b-6d5a-4a7d-9195-905d64aa434c service nova] Enqueued Resource ID: 42051b03-8b5b-4d44-b3bc-8b87353afdd7 with Priority: HIGHEST for action security_group_rules [ 1036.429993] env[65065]: INFO networking_nsxv3.common.synchronization [req-1a6a5fa9-8162-4d0d-b850-ebc593c84f05 req-2578305b-6d5a-4a7d-9195-905d64aa434c service nova] Enqueued Resource ID: 42051b03-8b5b-4d44-b3bc-8b87353afdd7 with Priority: HIGHEST for action security_group_members [ 1036.430176] env[65065]: INFO networking_nsxv3.common.synchronization [req-1a6a5fa9-8162-4d0d-b850-ebc593c84f05 req-2578305b-6d5a-4a7d-9195-905d64aa434c service nova] Enqueued Resource ID: 642b3e8f-ce2f-4a83-b490-79f4c306f5cd with Priority: HIGHEST for action port [ 1036.430768] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42051b03-8b5b-4d44-b3bc-8b87353afdd7 with Priority: HIGHEST for action security_group_rules [ 1036.431170] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42051b03-8b5b-4d44-b3bc-8b87353afdd7 with Priority: HIGHEST for action security_group_members [ 1036.431170] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 642b3e8f-ce2f-4a83-b490-79f4c306f5cd with Priority: HIGHEST for action port [ 1036.431284] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-42051b03-8b5b-4d44-b3bc-8b87353afdd7 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.431429] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-42051b03-8b5b-4d44-b3bc-8b87353afdd7" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.431479] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-42051b03-8b5b-4d44-b3bc-8b87353afdd7" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.431777] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-42051b03-8b5b-4d44-b3bc-8b87353afdd7" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.431866] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('42051b03-8b5b-4d44-b3bc-8b87353afdd7',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.432855] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-42051b03-8b5b-4d44-b3bc-8b87353afdd7 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.432978] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-42051b03-8b5b-4d44-b3bc-8b87353afdd7" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.433060] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-42051b03-8b5b-4d44-b3bc-8b87353afdd7" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.433231] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-42051b03-8b5b-4d44-b3bc-8b87353afdd7" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.433400] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.433490] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.433552] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.433699] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.433836] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.433872] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('42051b03-8b5b-4d44-b3bc-8b87353afdd7',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.434672] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-642b3e8f-ce2f-4a83-b490-79f4c306f5cd taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.435257] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-642b3e8f-ce2f-4a83-b490-79f4c306f5cd" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.435257] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-642b3e8f-ce2f-4a83-b490-79f4c306f5cd" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.435443] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-642b3e8f-ce2f-4a83-b490-79f4c306f5cd" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.435529] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('642b3e8f-ce2f-4a83-b490-79f4c306f5cd',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.938564] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('42051b03-8b5b-4d44-b3bc-8b87353afdd7',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.939931] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-42051b03-8b5b-4d44-b3bc-8b87353afdd7 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.940073] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-42051b03-8b5b-4d44-b3bc-8b87353afdd7" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.940196] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 642b3e8f-ce2f-4a83-b490-79f4c306f5cd with status ACTIVE [ 1036.940504] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.940603] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.940603] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.940790] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.940878] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.941072] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.941171] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.941237] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.941410] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.941464] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.941643] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.941731] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.941820] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.941923] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.941992] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.942213] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 642b3e8f-ce2f-4a83-b490-79f4c306f5cd is going to be updated. [ 1036.969145] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.969145] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.969145] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.969429] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.969429] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.969592] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-642b3e8f-ce2f-4a83-b490-79f4c306f5cd" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.004390] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.004579] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.004639] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.004839] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.004950] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.446529] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('42051b03-8b5b-4d44-b3bc-8b87353afdd7',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.507562] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.949555] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.949555] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.949555] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.949555] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.949555] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.949555] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 42051b03-8b5b-4d44-b3bc-8b87353afdd7 is going to be created. [ 1037.989662] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.989931] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.990075] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.990380] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.990565] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.003045] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 42051b03-8b5b-4d44-b3bc-8b87353afdd7 in Status: UNINITIALIZED for 2s [ 1038.009816] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.513085] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1038.513085] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1038.667945] env[65065]: INFO networking_nsxv3.common.synchronization [req-cc65643b-f4a1-4977-be24-6e98df5821ee req-8121786d-005d-4e2a-83fd-10ee726d4b41 tempest-AttachInterfacesTestJSON-1590270829 tempest-AttachInterfacesTestJSON-1590270829-project-member] Enqueued Resource ID: e2e5973c-5504-4cd5-9f92-77ba0193d841 with Priority: HIGHEST for action security_group_members [ 1038.668575] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2e5973c-5504-4cd5-9f92-77ba0193d841 with Priority: HIGHEST for action security_group_members [ 1038.668899] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2e5973c-5504-4cd5-9f92-77ba0193d841 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.669111] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.669195] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.669438] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.669596] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.669700] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.669755] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.670047] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.670047] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.670196] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2e5973c-5504-4cd5-9f92-77ba0193d841',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.092018] env[65065]: INFO networking_nsxv3.common.synchronization [req-3e647c4f-d649-4bfb-b1fe-744b903a96bc req-fb61b320-7390-4834-9e25-15345b945f0c tempest-ServersTestJSON-1126920631 tempest-ServersTestJSON-1126920631-project-member] Enqueued Resource ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 with Priority: HIGHEST for action security_group_members [ 1039.092404] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 with Priority: HIGHEST for action security_group_members [ 1039.092404] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e5f0086-b1e3-4f00-8207-8306f153d0e4 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.092558] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.092558] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.092755] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.096022] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.096022] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.096022] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.096022] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.096022] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.096022] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e5f0086-b1e3-4f00-8207-8306f153d0e4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.175356] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e2e5973c-5504-4cd5-9f92-77ba0193d841',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.359753] env[65065]: INFO networking_nsxv3.common.synchronization [None req-91a99c7f-f033-4434-b802-7ea717df55de tempest-AttachInterfacesTestJSON-1590270829 tempest-AttachInterfacesTestJSON-1590270829-project-member] Enqueued Resource ID: e2e5973c-5504-4cd5-9f92-77ba0193d841 with Priority: HIGHEST for action security_group_members [ 1039.360797] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2e5973c-5504-4cd5-9f92-77ba0193d841 with Priority: HIGHEST for action security_group_members [ 1039.361583] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2e5973c-5504-4cd5-9f92-77ba0193d841 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.361748] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.580031] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.580031] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.580401] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.580401] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.595043] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1039.600029] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.600029] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1039.600630] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1e5f0086-b1e3-4f00-8207-8306f153d0e4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.640252] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.640349] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.640560] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.640788] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.652927] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.654271] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1039.654271] env[65065]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65065) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1039.654271] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1039.667543] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock network-381 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.669029] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "network-381" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.669029] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "network-381" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.669029] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "network-381" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.669029] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.669301] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.669301] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.669491] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.669628] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.669897] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1039.669946] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1039.670064] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1039.670174] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1039.670282] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1039.670483] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1039.670598] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1039.677780] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e2e5973c-5504-4cd5-9f92-77ba0193d841',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.705240] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1039.706035] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Cache value generated in 0.035 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1039.706035] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1039.706035] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "network-381" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.706299] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock port-8f77856c-fd1a-442c-a55a-77ee18932704 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.706475] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "port-8f77856c-fd1a-442c-a55a-77ee18932704" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.706592] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "port-8f77856c-fd1a-442c-a55a-77ee18932704" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.706917] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "port-8f77856c-fd1a-442c-a55a-77ee18932704" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.707066] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8f77856c-fd1a-442c-a55a-77ee18932704',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.729832] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.729832] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.729832] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.730282] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.731582] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.731804] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1039.804417] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.804417] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.804417] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.804659] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.805429] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.805429] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1039.890874] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.891089] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.891089] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.891279] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.891552] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.891816] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:43. [ 1039.891919] env[65065]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'764b0b91-9c29-4261-b801-b1e924956192', 'f9002bdd-0416-4909-9ac7-2b8cecd66558', 'fd891ad9-a45a-48e0-b198-3697a1e81f8a', '6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e', 'b95b4f27-41f6-4a01-a1aa-aa16348ad807', 'b36fec68-8054-450e-a4b6-c700b29fd114', 'e9de3df0-a5b4-4be3-a63b-4d4baf532bbc', 'c587345b-51c8-42f7-8a0c-052027c4b18c', 'e6d7baac-4bff-46b9-b88d-2dc982621c0f', 'ea7028db-7886-4f7f-a360-7b19a81fd53e', 'ed4053b7-493c-48f8-b82e-b002cbcc3a61', 'd38273aa-e7d2-4aea-bcb1-2f5ae899e71f', 'ffd44fac-c762-408c-862b-ccea34e00947', 'cce60a92-c34e-445e-97a5-b8cfceb8b2b3', 'c16acdbe-d600-40de-b3d9-384201f1e513', '7299f16a-2557-464b-9f29-2b3b8469fc29', '45ff18a7-4a73-49de-af36-6c1d70b047f6', '5497a3e0-53ac-4406-b988-4b00f454ac4c', 'a793cfdd-5070-4bec-85b3-ff10a26c966f', '97377310-5980-4d43-8124-617efecbd7fb', 'f3805be6-3069-4624-897e-f4bf1dc6cd31', '9ed22036-e9a4-4639-89b9-c743ca686b09', 'c264aab4-0245-4fdf-8152-a3476b7dd553', 'a7006bfc-4bfa-49da-a51e-6cc26b8098c3', 'd0abfe3e-a5d3-4a8d-bdc5-c03daff4976f', '9576b45f-b344-47bd-8f8b-9df4c3725ddb', '37c3f83a-5710-4c20-abeb-08e60639bed8', 'adad9983-8e2e-4bac-8155-8a076b03abc3', '7d0941d4-57d8-45e9-9f2f-95128b8136e5', 'cc04914d-716e-49e1-8a77-946f904f69bb', '36b0a7bf-c185-47f8-9c6c-88ed66cc1f56', '5501386c-6d40-4911-b095-561660dd038b', '1e5f0086-b1e3-4f00-8207-8306f153d0e4', '6c6d05e2-e80c-477f-9eea-12f17d58d439', 'afe348a4-4bdc-4830-8b52-3584e5dee837', '386d96b4-ccad-4c04-8bda-534b3f25dc91', 'e2e5973c-5504-4cd5-9f92-77ba0193d841', 'e4ff6072-a232-4ebe-b049-2085dcef5991', '4a714159-17dd-4324-93b8-81c81e256b0e', '99423afc-7fd3-4e3d-8a84-f190e0af048f', '1a8690bf-b436-47bf-abed-9ade6d6d5c3f', '4473193a-198b-4342-a9ef-a1966ddd9441', '1b329aa6-2b06-4112-ad10-7c2ede9e4774'} {{(pid=65065) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1039.892036] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1039.911477] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.911651] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.911698] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.911898] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.911979] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.912102] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1039.912172] env[65065]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65065) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1039.912243] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1039.934989] env[65065]: INFO networking_nsxv3.common.synchronization [None req-0a75dc8b-a35c-43d3-9644-79d71be482ea None None] Enqueued Resource ID: c3c84dee-b321-4efd-9e4e-482a49255931 with Priority: HIGHEST for action port [ 1039.935772] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3c84dee-b321-4efd-9e4e-482a49255931 with Priority: HIGHEST for action port [ 1039.936168] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-c3c84dee-b321-4efd-9e4e-482a49255931 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.936292] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c3c84dee-b321-4efd-9e4e-482a49255931" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.936359] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c3c84dee-b321-4efd-9e4e-482a49255931" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.936602] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c3c84dee-b321-4efd-9e4e-482a49255931" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.936685] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c3c84dee-b321-4efd-9e4e-482a49255931',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.999089] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.999323] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.999323] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.999491] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.000502] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.000753] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1040.000845] env[65065]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65065) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1040.000887] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1040.000952] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1040.001047] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/43 resources of Type:Security Group Rules [ 1040.001122] env[65065]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 764b0b91-9c29-4261-b801-b1e924956192 with Priority: HIGH for action security_group_rules [ 1040.001199] env[65065]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f9002bdd-0416-4909-9ac7-2b8cecd66558 with Priority: HIGH for action security_group_rules [ 1040.001284] env[65065]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fd891ad9-a45a-48e0-b198-3697a1e81f8a with Priority: HIGH for action security_group_rules [ 1040.001359] env[65065]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e with Priority: HIGH for action security_group_rules [ 1040.001438] env[65065]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b95b4f27-41f6-4a01-a1aa-aa16348ad807 with Priority: HIGH for action security_group_rules [ 1040.001489] env[65065]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b36fec68-8054-450e-a4b6-c700b29fd114 with Priority: HIGH for action security_group_rules [ 1040.001550] env[65065]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e9de3df0-a5b4-4be3-a63b-4d4baf532bbc with Priority: HIGH for action security_group_rules [ 1040.001609] env[65065]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c587345b-51c8-42f7-8a0c-052027c4b18c with Priority: HIGH for action security_group_rules [ 1040.001667] env[65065]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e6d7baac-4bff-46b9-b88d-2dc982621c0f with Priority: HIGH for action security_group_rules [ 1040.001726] env[65065]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ea7028db-7886-4f7f-a360-7b19a81fd53e with Priority: HIGH for action security_group_rules [ 1040.001785] env[65065]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ed4053b7-493c-48f8-b82e-b002cbcc3a61 with Priority: HIGH for action security_group_rules [ 1040.001844] env[65065]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d38273aa-e7d2-4aea-bcb1-2f5ae899e71f with Priority: HIGH for action security_group_rules [ 1040.001904] env[65065]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ffd44fac-c762-408c-862b-ccea34e00947 with Priority: HIGH for action security_group_rules [ 1040.001963] env[65065]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cce60a92-c34e-445e-97a5-b8cfceb8b2b3 with Priority: HIGH for action security_group_rules [ 1040.002036] env[65065]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c16acdbe-d600-40de-b3d9-384201f1e513 with Priority: HIGH for action security_group_rules [ 1040.002098] env[65065]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7299f16a-2557-464b-9f29-2b3b8469fc29 with Priority: HIGH for action security_group_rules [ 1040.002157] env[65065]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 45ff18a7-4a73-49de-af36-6c1d70b047f6 with Priority: HIGH for action security_group_rules [ 1040.002217] env[65065]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5497a3e0-53ac-4406-b988-4b00f454ac4c with Priority: HIGH for action security_group_rules [ 1040.002277] env[65065]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a793cfdd-5070-4bec-85b3-ff10a26c966f with Priority: HIGH for action security_group_rules [ 1040.002337] env[65065]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 97377310-5980-4d43-8124-617efecbd7fb with Priority: HIGH for action security_group_rules [ 1040.002428] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.013291] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 42051b03-8b5b-4d44-b3bc-8b87353afdd7 in Status: SUCCESS [ 1040.013587] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-42051b03-8b5b-4d44-b3bc-8b87353afdd7" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.015645] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-42051b03-8b5b-4d44-b3bc-8b87353afdd7" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.015968] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-42051b03-8b5b-4d44-b3bc-8b87353afdd7" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.016279] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.016471] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.016587] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.016852] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.016986] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.017227] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-42051b03-8b5b-4d44-b3bc-8b87353afdd7" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.017271] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('42051b03-8b5b-4d44-b3bc-8b87353afdd7',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.102870] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1e5f0086-b1e3-4f00-8207-8306f153d0e4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.181041] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.181253] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.181253] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.181417] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.181736] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.181736] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2e5973c-5504-4cd5-9f92-77ba0193d841 is going to be updated. [ 1040.210178] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.210451] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.210669] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.210863] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.211023] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.211265] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Segment Port 8f77856c-fd1a-442c-a55a-77ee18932704 not found, creating... [ 1040.211586] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.211756] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.211904] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.212160] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.212298] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.212591] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.212774] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.213056] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.213294] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.213422] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.213564] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Resource: SegmentPort with ID: 8f77856c-fd1a-442c-a55a-77ee18932704 is going to be created. [ 1040.216146] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.217221] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.217221] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.217221] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.217221] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.229796] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2e5973c-5504-4cd5-9f92-77ba0193d841 in Status: IN_PROGRESS for 2s [ 1040.248434] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.249532] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.249844] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.250342] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.250863] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.251286] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "port-8f77856c-fd1a-442c-a55a-77ee18932704" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.439110] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c3c84dee-b321-4efd-9e4e-482a49255931 [ 1040.439366] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.439493] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.439559] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.439775] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.439858] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.439948] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c3c84dee-b321-4efd-9e4e-482a49255931 already deleted. [ 1040.440035] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c3c84dee-b321-4efd-9e4e-482a49255931" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.522280] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-42051b03-8b5b-4d44-b3bc-8b87353afdd7 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.522577] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-42051b03-8b5b-4d44-b3bc-8b87353afdd7" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.522690] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-42051b03-8b5b-4d44-b3bc-8b87353afdd7" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.522856] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-42051b03-8b5b-4d44-b3bc-8b87353afdd7" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.523043] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.523136] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.523199] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.523348] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.523431] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.523514] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-42051b03-8b5b-4d44-b3bc-8b87353afdd7" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.523705] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-42051b03-8b5b-4d44-b3bc-8b87353afdd7 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.523845] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-42051b03-8b5b-4d44-b3bc-8b87353afdd7" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.523937] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-42051b03-8b5b-4d44-b3bc-8b87353afdd7" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.524159] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-42051b03-8b5b-4d44-b3bc-8b87353afdd7" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.524311] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.524406] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.524468] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.524607] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.524685] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.524765] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-42051b03-8b5b-4d44-b3bc-8b87353afdd7" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.524870] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('42051b03-8b5b-4d44-b3bc-8b87353afdd7',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.607039] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.607039] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.607039] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.607039] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.607039] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.607039] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 is going to be updated. [ 1040.637115] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.637875] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.637875] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.637875] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.637875] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.649789] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 in Status: IN_PROGRESS for 2s [ 1041.022565] env[65065]: INFO networking_nsxv3.common.synchronization [req-3e647c4f-d649-4bfb-b1fe-744b903a96bc req-e04d26ab-025f-4718-9e96-946267ba0a5a service nova] Enqueued Resource ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 with Priority: HIGHEST for action security_group_rules [ 1041.023544] env[65065]: INFO networking_nsxv3.common.synchronization [req-3e647c4f-d649-4bfb-b1fe-744b903a96bc req-e04d26ab-025f-4718-9e96-946267ba0a5a service nova] Enqueued Resource ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 with Priority: HIGHEST for action security_group_members [ 1041.023544] env[65065]: INFO networking_nsxv3.common.synchronization [req-3e647c4f-d649-4bfb-b1fe-744b903a96bc req-e04d26ab-025f-4718-9e96-946267ba0a5a service nova] Enqueued Resource ID: 8f77856c-fd1a-442c-a55a-77ee18932704 with Priority: HIGHEST for action port [ 1041.024054] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 with Priority: HIGHEST for action security_group_rules [ 1041.024130] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 with Priority: HIGHEST for action security_group_members [ 1041.024498] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f77856c-fd1a-442c-a55a-77ee18932704 with Priority: HIGHEST for action port [ 1041.024498] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 764b0b91-9c29-4261-b801-b1e924956192 with Priority: HIGH for action security_group_rules [ 1041.024498] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd891ad9-a45a-48e0-b198-3697a1e81f8a with Priority: HIGH for action security_group_rules [ 1041.024665] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9de3df0-a5b4-4be3-a63b-4d4baf532bbc with Priority: HIGH for action security_group_rules [ 1041.024714] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c16acdbe-d600-40de-b3d9-384201f1e513 with Priority: HIGH for action security_group_rules [ 1041.025066] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97377310-5980-4d43-8124-617efecbd7fb with Priority: HIGH for action security_group_rules [ 1041.025066] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a793cfdd-5070-4bec-85b3-ff10a26c966f with Priority: HIGH for action security_group_rules [ 1041.025066] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5497a3e0-53ac-4406-b988-4b00f454ac4c with Priority: HIGH for action security_group_rules [ 1041.025300] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45ff18a7-4a73-49de-af36-6c1d70b047f6 with Priority: HIGH for action security_group_rules [ 1041.025300] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cce60a92-c34e-445e-97a5-b8cfceb8b2b3 with Priority: HIGH for action security_group_rules [ 1041.025389] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7299f16a-2557-464b-9f29-2b3b8469fc29 with Priority: HIGH for action security_group_rules [ 1041.026760] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ffd44fac-c762-408c-862b-ccea34e00947 with Priority: HIGH for action security_group_rules [ 1041.026760] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d38273aa-e7d2-4aea-bcb1-2f5ae899e71f with Priority: HIGH for action security_group_rules [ 1041.026760] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed4053b7-493c-48f8-b82e-b002cbcc3a61 with Priority: HIGH for action security_group_rules [ 1041.026760] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea7028db-7886-4f7f-a360-7b19a81fd53e with Priority: HIGH for action security_group_rules [ 1041.026760] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6d7baac-4bff-46b9-b88d-2dc982621c0f with Priority: HIGH for action security_group_rules [ 1041.026760] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b36fec68-8054-450e-a4b6-c700b29fd114 with Priority: HIGH for action security_group_rules [ 1041.026760] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c587345b-51c8-42f7-8a0c-052027c4b18c with Priority: HIGH for action security_group_rules [ 1041.026760] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b95b4f27-41f6-4a01-a1aa-aa16348ad807 with Priority: HIGH for action security_group_rules [ 1041.026760] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9002bdd-0416-4909-9ac7-2b8cecd66558 with Priority: HIGH for action security_group_rules [ 1041.026760] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e with Priority: HIGH for action security_group_rules [ 1041.026760] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1e5f0086-b1e3-4f00-8207-8306f153d0e4 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.027701] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.027701] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.027701] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.027701] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1e5f0086-b1e3-4f00-8207-8306f153d0e4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.028811] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e5f0086-b1e3-4f00-8207-8306f153d0e4 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.028959] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.030043] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-8f77856c-fd1a-442c-a55a-77ee18932704 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.030043] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8f77856c-fd1a-442c-a55a-77ee18932704" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.030043] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8f77856c-fd1a-442c-a55a-77ee18932704" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.030043] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8f77856c-fd1a-442c-a55a-77ee18932704" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.030043] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8f77856c-fd1a-442c-a55a-77ee18932704',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.032706] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-764b0b91-9c29-4261-b801-b1e924956192 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.032706] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-764b0b91-9c29-4261-b801-b1e924956192" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.032706] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-764b0b91-9c29-4261-b801-b1e924956192" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.032706] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-764b0b91-9c29-4261-b801-b1e924956192" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.032706] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('764b0b91-9c29-4261-b801-b1e924956192',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.033580] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fd891ad9-a45a-48e0-b198-3697a1e81f8a taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.033580] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fd891ad9-a45a-48e0-b198-3697a1e81f8a" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.033580] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fd891ad9-a45a-48e0-b198-3697a1e81f8a" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.033848] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fd891ad9-a45a-48e0-b198-3697a1e81f8a" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.033962] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fd891ad9-a45a-48e0-b198-3697a1e81f8a',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.038762] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.038929] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.038989] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.039236] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.039309] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e9de3df0-a5b4-4be3-a63b-4d4baf532bbc',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.040842] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c16acdbe-d600-40de-b3d9-384201f1e513 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.040981] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c16acdbe-d600-40de-b3d9-384201f1e513" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.041139] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c16acdbe-d600-40de-b3d9-384201f1e513" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.041343] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c16acdbe-d600-40de-b3d9-384201f1e513" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.041460] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c16acdbe-d600-40de-b3d9-384201f1e513',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.046923] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-97377310-5980-4d43-8124-617efecbd7fb taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.046923] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-97377310-5980-4d43-8124-617efecbd7fb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.046923] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-97377310-5980-4d43-8124-617efecbd7fb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.046923] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-97377310-5980-4d43-8124-617efecbd7fb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.046923] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('97377310-5980-4d43-8124-617efecbd7fb',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.047292] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a793cfdd-5070-4bec-85b3-ff10a26c966f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.047292] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a793cfdd-5070-4bec-85b3-ff10a26c966f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.047292] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a793cfdd-5070-4bec-85b3-ff10a26c966f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.049847] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a793cfdd-5070-4bec-85b3-ff10a26c966f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.049847] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a793cfdd-5070-4bec-85b3-ff10a26c966f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.049847] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5497a3e0-53ac-4406-b988-4b00f454ac4c taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.049847] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5497a3e0-53ac-4406-b988-4b00f454ac4c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.049847] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5497a3e0-53ac-4406-b988-4b00f454ac4c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.049847] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5497a3e0-53ac-4406-b988-4b00f454ac4c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.049847] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5497a3e0-53ac-4406-b988-4b00f454ac4c',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.051106] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-45ff18a7-4a73-49de-af36-6c1d70b047f6 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.051229] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-45ff18a7-4a73-49de-af36-6c1d70b047f6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.051297] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-45ff18a7-4a73-49de-af36-6c1d70b047f6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.051941] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-45ff18a7-4a73-49de-af36-6c1d70b047f6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.051941] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('45ff18a7-4a73-49de-af36-6c1d70b047f6',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.053448] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cce60a92-c34e-445e-97a5-b8cfceb8b2b3 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.053611] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cce60a92-c34e-445e-97a5-b8cfceb8b2b3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.054339] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cce60a92-c34e-445e-97a5-b8cfceb8b2b3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.054339] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cce60a92-c34e-445e-97a5-b8cfceb8b2b3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.054339] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cce60a92-c34e-445e-97a5-b8cfceb8b2b3',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.054813] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7299f16a-2557-464b-9f29-2b3b8469fc29 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.055221] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7299f16a-2557-464b-9f29-2b3b8469fc29" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.055294] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7299f16a-2557-464b-9f29-2b3b8469fc29" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.055473] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7299f16a-2557-464b-9f29-2b3b8469fc29" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.055556] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7299f16a-2557-464b-9f29-2b3b8469fc29',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.056799] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ffd44fac-c762-408c-862b-ccea34e00947 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.056799] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.056799] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.056799] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.057009] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ffd44fac-c762-408c-862b-ccea34e00947',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.058744] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d38273aa-e7d2-4aea-bcb1-2f5ae899e71f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.058875] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d38273aa-e7d2-4aea-bcb1-2f5ae899e71f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.058925] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d38273aa-e7d2-4aea-bcb1-2f5ae899e71f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.059139] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d38273aa-e7d2-4aea-bcb1-2f5ae899e71f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.059217] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d38273aa-e7d2-4aea-bcb1-2f5ae899e71f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.060398] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ed4053b7-493c-48f8-b82e-b002cbcc3a61 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.060550] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.060619] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.060783] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.060875] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ed4053b7-493c-48f8-b82e-b002cbcc3a61',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.061914] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ea7028db-7886-4f7f-a360-7b19a81fd53e taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.062052] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ea7028db-7886-4f7f-a360-7b19a81fd53e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.062115] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ea7028db-7886-4f7f-a360-7b19a81fd53e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.062275] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ea7028db-7886-4f7f-a360-7b19a81fd53e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.062356] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ea7028db-7886-4f7f-a360-7b19a81fd53e',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.063176] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e6d7baac-4bff-46b9-b88d-2dc982621c0f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.063354] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.063354] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.063511] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.063586] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e6d7baac-4bff-46b9-b88d-2dc982621c0f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.064621] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b36fec68-8054-450e-a4b6-c700b29fd114 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.065040] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b36fec68-8054-450e-a4b6-c700b29fd114" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.065040] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b36fec68-8054-450e-a4b6-c700b29fd114" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.065040] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b36fec68-8054-450e-a4b6-c700b29fd114" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.065040] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b36fec68-8054-450e-a4b6-c700b29fd114',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.065752] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c587345b-51c8-42f7-8a0c-052027c4b18c taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.066549] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c587345b-51c8-42f7-8a0c-052027c4b18c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.066549] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c587345b-51c8-42f7-8a0c-052027c4b18c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.066549] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c587345b-51c8-42f7-8a0c-052027c4b18c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.066549] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c587345b-51c8-42f7-8a0c-052027c4b18c',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.067748] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b95b4f27-41f6-4a01-a1aa-aa16348ad807 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.067748] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b95b4f27-41f6-4a01-a1aa-aa16348ad807" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.067748] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b95b4f27-41f6-4a01-a1aa-aa16348ad807" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.067748] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b95b4f27-41f6-4a01-a1aa-aa16348ad807" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.067927] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b95b4f27-41f6-4a01-a1aa-aa16348ad807',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.068860] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f9002bdd-0416-4909-9ac7-2b8cecd66558 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.068988] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f9002bdd-0416-4909-9ac7-2b8cecd66558" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.069085] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f9002bdd-0416-4909-9ac7-2b8cecd66558" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.069290] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f9002bdd-0416-4909-9ac7-2b8cecd66558" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.069364] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f9002bdd-0416-4909-9ac7-2b8cecd66558',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.070217] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.070399] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.070529] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.070668] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.070744] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.076077] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 42051b03-8b5b-4d44-b3bc-8b87353afdd7: rpc.has_security_group_logging(os_id): False [ 1041.099354] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.099527] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.099597] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.099810] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.100112] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.100112] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.100242] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.100278] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.101029] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.101029] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.101141] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.102045] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.102045] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.102045] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.102045] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.102045] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.102045] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.102045] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.102045] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.102424] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.102424] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 42051b03-8b5b-4d44-b3bc-8b87353afdd7 is going to be created. [ 1041.192370] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.192370] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.192370] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.192370] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.192370] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.204794] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 42051b03-8b5b-4d44-b3bc-8b87353afdd7 in Status: IN_PROGRESS for 2s [ 1041.566244] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.566338] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.566485] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.566656] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.574449] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-b95b4f27-41f6-4a01-a1aa-aa16348ad807 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.574449] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b95b4f27-41f6-4a01-a1aa-aa16348ad807" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.574449] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b95b4f27-41f6-4a01-a1aa-aa16348ad807" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.574679] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b95b4f27-41f6-4a01-a1aa-aa16348ad807" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.576078] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.576078] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.576078] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.576078] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.576078] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.576078] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b95b4f27-41f6-4a01-a1aa-aa16348ad807" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.576078] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b95b4f27-41f6-4a01-a1aa-aa16348ad807',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.581185] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e5f0086-b1e3-4f00-8207-8306f153d0e4 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.582353] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.588737] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.588939] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.590980] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-97377310-5980-4d43-8124-617efecbd7fb taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.591627] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-97377310-5980-4d43-8124-617efecbd7fb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.591775] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-97377310-5980-4d43-8124-617efecbd7fb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.592036] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-97377310-5980-4d43-8124-617efecbd7fb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.593201] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.593201] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.593201] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.593201] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.593201] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.593201] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-97377310-5980-4d43-8124-617efecbd7fb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.593201] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('97377310-5980-4d43-8124-617efecbd7fb',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.595572] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-cce60a92-c34e-445e-97a5-b8cfceb8b2b3 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.595572] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cce60a92-c34e-445e-97a5-b8cfceb8b2b3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.595572] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cce60a92-c34e-445e-97a5-b8cfceb8b2b3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.595572] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cce60a92-c34e-445e-97a5-b8cfceb8b2b3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.595572] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.596203] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.596203] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.596203] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.596203] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.596203] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cce60a92-c34e-445e-97a5-b8cfceb8b2b3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.596203] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cce60a92-c34e-445e-97a5-b8cfceb8b2b3',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.597903] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-c587345b-51c8-42f7-8a0c-052027c4b18c taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.598096] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c587345b-51c8-42f7-8a0c-052027c4b18c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.598096] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c587345b-51c8-42f7-8a0c-052027c4b18c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.598252] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c587345b-51c8-42f7-8a0c-052027c4b18c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.598434] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.598573] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.598638] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.598789] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.599257] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.599257] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c587345b-51c8-42f7-8a0c-052027c4b18c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.599257] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c587345b-51c8-42f7-8a0c-052027c4b18c',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.607867] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8f77856c-fd1a-442c-a55a-77ee18932704 with status ACTIVE [ 1041.608608] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.608728] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.608888] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.609031] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.609126] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.609314] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.609404] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.609463] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.609612] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.609687] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.609867] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.609975] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.610511] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.610738] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.610873] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.611035] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8f77856c-fd1a-442c-a55a-77ee18932704 is going to be updated. [ 1041.618181] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.618417] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.618417] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.618648] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.618839] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.618978] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.619063] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.619662] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.619755] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.619846] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.619939] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.630040] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.630269] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.632570] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('97377310-5980-4d43-8124-617efecbd7fb',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.635713] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cce60a92-c34e-445e-97a5-b8cfceb8b2b3',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.639220] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.639407] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fd891ad9-a45a-48e0-b198-3697a1e81f8a is going to be deleted. [ 1041.642765] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.642765] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.689362] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.689362] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.696639] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.696805] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.699024] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.699976] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.701326] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.701535] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.702499] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.702726] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.704581] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.704581] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.704936] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.704993] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.706096] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.706598] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.707854] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.707854] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.708554] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.708689] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 45ff18a7-4a73-49de-af36-6c1d70b047f6 is going to be deleted. [ 1041.710439] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.710947] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.711071] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.711465] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.714361] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.714361] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.715023] env[65065]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1041.716098] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.716098] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.716098] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.716098] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.716304] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.716358] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8f77856c-fd1a-442c-a55a-77ee18932704" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.717075] env[65065]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1041.717577] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.717709] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.749025] env[65065]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1041.749657] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.749792] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ed4053b7-493c-48f8-b82e-b002cbcc3a61 is going to be deleted. [ 1041.750827] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.751120] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.776922] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.777176] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.784675] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.784862] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ea7028db-7886-4f7f-a360-7b19a81fd53e is going to be deleted. [ 1041.785947] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.786198] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.833272] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.833336] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d38273aa-e7d2-4aea-bcb1-2f5ae899e71f is going to be deleted. [ 1041.834720] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.835042] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.867158] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.867364] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.867989] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.868097] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.882144] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.882320] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e9de3df0-a5b4-4be3-a63b-4d4baf532bbc is going to be deleted. [ 1041.883221] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.883469] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.956716] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.956982] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.973642] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.973642] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 764b0b91-9c29-4261-b801-b1e924956192 is going to be deleted. [ 1041.974660] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.975275] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.991862] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.992176] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.035528] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.035717] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a793cfdd-5070-4bec-85b3-ff10a26c966f is going to be deleted. [ 1042.036672] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.036913] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.084151] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b95b4f27-41f6-4a01-a1aa-aa16348ad807',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.092482] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.092622] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.110021] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.110021] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e6d7baac-4bff-46b9-b88d-2dc982621c0f is going to be deleted. [ 1042.110623] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.111303] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.127163] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.127619] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.130174] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c587345b-51c8-42f7-8a0c-052027c4b18c',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.145336] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cce60a92-c34e-445e-97a5-b8cfceb8b2b3: rpc.has_security_group_logging(os_id): False [ 1042.147319] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 97377310-5980-4d43-8124-617efecbd7fb: rpc.has_security_group_logging(os_id): False [ 1042.147869] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.212023] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.212023] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f9002bdd-0416-4909-9ac7-2b8cecd66558 is going to be deleted. [ 1042.212023] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.212023] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.214367] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.214776] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.224320] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.225244] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.225890] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.226794] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.247308] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2e5973c-5504-4cd5-9f92-77ba0193d841 in Status: SUCCESS [ 1042.247982] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.249844] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.249844] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.249844] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.249844] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.249844] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.249844] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.249844] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.249844] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2e5973c-5504-4cd5-9f92-77ba0193d841',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.276065] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.276573] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7299f16a-2557-464b-9f29-2b3b8469fc29 is going to be deleted. [ 1042.279211] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.279211] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.282218] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.282525] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.330994] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.331234] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5497a3e0-53ac-4406-b988-4b00f454ac4c is going to be deleted. [ 1042.332381] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.332633] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.335643] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.335951] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.390207] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.390394] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ffd44fac-c762-408c-862b-ccea34e00947 is going to be deleted. [ 1042.391435] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.391749] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.407032] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.407032] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.444716] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.444932] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b36fec68-8054-450e-a4b6-c700b29fd114 is going to be deleted. [ 1042.446468] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.446782] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.449733] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.449733] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.510173] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.510295] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c16acdbe-d600-40de-b3d9-384201f1e513 is going to be deleted. [ 1042.511599] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.511721] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.511987] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.511987] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fd891ad9-a45a-48e0-b198-3697a1e81f8a" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.514118] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.514118] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.514233] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.514267] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ed4053b7-493c-48f8-b82e-b002cbcc3a61" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.514901] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.515184] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.515272] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.515490] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-45ff18a7-4a73-49de-af36-6c1d70b047f6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.518063] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.518307] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.518666] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.518666] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ea7028db-7886-4f7f-a360-7b19a81fd53e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.519172] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.519172] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.519172] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.519172] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d38273aa-e7d2-4aea-bcb1-2f5ae899e71f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.519301] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.520764] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.520764] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.520764] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e9de3df0-a5b4-4be3-a63b-4d4baf532bbc" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.520764] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.520764] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.520764] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.520764] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-764b0b91-9c29-4261-b801-b1e924956192" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.520764] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.520764] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.520764] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.520764] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a793cfdd-5070-4bec-85b3-ff10a26c966f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.520764] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.521496] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.554768] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.554990] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.582814] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.583216] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.583337] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.583425] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.583656] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.583741] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.583911] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 97377310-5980-4d43-8124-617efecbd7fb is going to be updated. [ 1042.585048] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.585243] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.586289] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b95b4f27-41f6-4a01-a1aa-aa16348ad807: rpc.has_security_group_logging(os_id): False [ 1042.589405] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.589533] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.632605] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c587345b-51c8-42f7-8a0c-052027c4b18c: rpc.has_security_group_logging(os_id): False [ 1042.653991] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e: rpc.has_security_group_logging(os_id): False [ 1042.677190] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.677563] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.683227] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 in Status: SUCCESS [ 1042.683533] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.684357] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.684357] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.684357] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.684357] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.684357] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.684357] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.684867] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.684867] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e5f0086-b1e3-4f00-8207-8306f153d0e4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.686407] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.686591] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.687893] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.688419] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.693028] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.693028] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.693367] env[65065]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1042.693698] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.694124] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.694250] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.694373] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.694556] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.694679] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.694764] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cce60a92-c34e-445e-97a5-b8cfceb8b2b3 is going to be updated. [ 1042.695979] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.696433] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.696550] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.696656] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f9002bdd-0416-4909-9ac7-2b8cecd66558" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.696821] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.697980] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.697980] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.697980] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7299f16a-2557-464b-9f29-2b3b8469fc29" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.697980] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.697980] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.697980] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.697980] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5497a3e0-53ac-4406-b988-4b00f454ac4c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.698368] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.698994] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.698994] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.698994] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ffd44fac-c762-408c-862b-ccea34e00947" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.699438] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.699608] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.699698] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.699824] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e6d7baac-4bff-46b9-b88d-2dc982621c0f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.700029] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.700189] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.700529] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.700670] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b36fec68-8054-450e-a4b6-c700b29fd114" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.700820] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.700952] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.744390] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.744895] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.745402] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.745402] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.745550] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.745550] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.745676] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c587345b-51c8-42f7-8a0c-052027c4b18c is going to be updated. [ 1042.747151] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.747416] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.754679] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.754679] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.860073] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.860485] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.860621] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.860703] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.860960] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.861089] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.862054] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b95b4f27-41f6-4a01-a1aa-aa16348ad807 is going to be updated. [ 1042.863698] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.863698] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.863698] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.863698] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c16acdbe-d600-40de-b3d9-384201f1e513" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.864448] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.864513] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.912431] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.912431] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.936270] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.936598] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.936781] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.936854] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.937088] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.937427] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.937551] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e is going to be updated. [ 1042.939935] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.940350] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.997194] env[65065]: INFO networking_nsxv3.common.synchronization [None req-6ca6e15b-ed24-4e96-a028-b508b7e81116 None None] Enqueued Resource ID: 4d808eb4-e570-477c-9fad-529f1cd4f4eb with Priority: HIGHEST for action port [ 1042.998087] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d808eb4-e570-477c-9fad-529f1cd4f4eb with Priority: HIGHEST for action port [ 1042.998611] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-4d808eb4-e570-477c-9fad-529f1cd4f4eb taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.998860] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4d808eb4-e570-477c-9fad-529f1cd4f4eb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.998956] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4d808eb4-e570-477c-9fad-529f1cd4f4eb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.000060] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4d808eb4-e570-477c-9fad-529f1cd4f4eb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.000060] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4d808eb4-e570-477c-9fad-529f1cd4f4eb',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.006791] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.006791] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.009193] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.009415] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.063880] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.064189] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.102505] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.102898] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.103100] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.103198] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.103595] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.103732] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.103880] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2e5973c-5504-4cd5-9f92-77ba0193d841 is going to be updated. [ 1043.108249] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.112033] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.112033] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.112033] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.112033] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.112033] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.112033] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.112033] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.112033] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.113072] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.113237] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.113361] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.160709] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c587345b-51c8-42f7-8a0c-052027c4b18c in Status: IN_PROGRESS for 2s [ 1043.163188] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 97377310-5980-4d43-8124-617efecbd7fb in Status: IN_PROGRESS for 2s [ 1043.163866] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cce60a92-c34e-445e-97a5-b8cfceb8b2b3 in Status: IN_PROGRESS for 2s [ 1043.185839] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b95b4f27-41f6-4a01-a1aa-aa16348ad807 in Status: IN_PROGRESS for 2s [ 1043.189727] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1e5f0086-b1e3-4f00-8207-8306f153d0e4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.193197] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.193197] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.193197] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.193197] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.193197] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.216545] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.216921] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.216921] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.216997] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.217305] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.229413] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 42051b03-8b5b-4d44-b3bc-8b87353afdd7 in Status: SUCCESS [ 1043.231584] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-42051b03-8b5b-4d44-b3bc-8b87353afdd7" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.232058] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2e5973c-5504-4cd5-9f92-77ba0193d841 in Status: IN_PROGRESS for 2s [ 1043.233248] env[65065]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1043.233932] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e in Status: IN_PROGRESS for 2s [ 1043.287955] env[65065]: INFO networking_nsxv3.common.synchronization [None req-ab8e07f3-831f-476a-b1c3-ba07128257f7 None None] Enqueued Resource ID: 28297bfe-de10-46e1-aeb8-6d9fdcf9ec9c with Priority: HIGHEST for action port [ 1043.288558] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28297bfe-de10-46e1-aeb8-6d9fdcf9ec9c with Priority: HIGHEST for action port [ 1043.288854] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-28297bfe-de10-46e1-aeb8-6d9fdcf9ec9c taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.288977] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-28297bfe-de10-46e1-aeb8-6d9fdcf9ec9c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.289895] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-28297bfe-de10-46e1-aeb8-6d9fdcf9ec9c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.289895] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-28297bfe-de10-46e1-aeb8-6d9fdcf9ec9c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.289895] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('28297bfe-de10-46e1-aeb8-6d9fdcf9ec9c',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.438396] env[65065]: INFO networking_nsxv3.common.synchronization [req-532c93af-7c22-4184-9357-7d7d1a4609a9 req-5f4bf3d2-3825-4669-b442-89ce548ad879 tempest-DeleteServersTestJSON-1316666736 tempest-DeleteServersTestJSON-1316666736-project-member] Enqueued Resource ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 with Priority: HIGHEST for action security_group_members [ 1043.439422] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 with Priority: HIGHEST for action security_group_members [ 1043.439422] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d0941d4-57d8-45e9-9f2f-95128b8136e5 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.439585] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.439654] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.439864] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.441407] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.441407] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.441407] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.441407] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.441407] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.441407] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d0941d4-57d8-45e9-9f2f-95128b8136e5',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.504055] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4d808eb4-e570-477c-9fad-529f1cd4f4eb [ 1043.504055] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.504055] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.504055] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.504055] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.504664] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.504664] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4d808eb4-e570-477c-9fad-529f1cd4f4eb already deleted. [ 1043.504664] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4d808eb4-e570-477c-9fad-529f1cd4f4eb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.693329] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1e5f0086-b1e3-4f00-8207-8306f153d0e4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.792669] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 28297bfe-de10-46e1-aeb8-6d9fdcf9ec9c [ 1043.792669] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.792669] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.792669] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.793020] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.793020] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.793312] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:28297bfe-de10-46e1-aeb8-6d9fdcf9ec9c already deleted. [ 1043.793312] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-28297bfe-de10-46e1-aeb8-6d9fdcf9ec9c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.943722] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.943722] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.943722] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.943917] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.971056] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.971232] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.971232] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.971901] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.971901] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.971901] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.971901] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 is going to be updated. [ 1044.017248] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.017435] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.017588] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.017891] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.018149] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.029850] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 in Status: IN_PROGRESS for 2s [ 1044.196938] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.197520] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.197661] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.198030] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.198030] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.198030] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 is going to be updated. [ 1044.228187] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.228510] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.228824] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.228824] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.228896] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.240043] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 in Status: IN_PROGRESS for 2s [ 1044.320230] env[65065]: INFO networking_nsxv3.common.synchronization [req-bb763484-d9f8-4295-ba25-2d807fbd4313 req-c7623615-0a05-4f6a-859d-150864b82338 tempest-AttachInterfacesTestJSON-1590270829 tempest-AttachInterfacesTestJSON-1590270829-project-member] Enqueued Resource ID: cce60a92-c34e-445e-97a5-b8cfceb8b2b3 with Priority: HIGHEST for action security_group_members [ 1044.321209] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cce60a92-c34e-445e-97a5-b8cfceb8b2b3 with Priority: HIGHEST for action security_group_members [ 1044.321209] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-cce60a92-c34e-445e-97a5-b8cfceb8b2b3 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.321209] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cce60a92-c34e-445e-97a5-b8cfceb8b2b3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.321209] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cce60a92-c34e-445e-97a5-b8cfceb8b2b3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.321456] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cce60a92-c34e-445e-97a5-b8cfceb8b2b3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.321491] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.321667] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.321729] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.321922] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.322039] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.322872] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cce60a92-c34e-445e-97a5-b8cfceb8b2b3',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.824481] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.824748] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.824748] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.824905] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.825081] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.825335] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.825450] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.825450] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.825668] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.825753] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.825819] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cce60a92-c34e-445e-97a5-b8cfceb8b2b3 is going to be updated. [ 1044.856147] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.856353] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.856353] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.856545] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.856674] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.883286] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cce60a92-c34e-445e-97a5-b8cfceb8b2b3 in Status: IN_PROGRESS for 2s [ 1045.180158] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c587345b-51c8-42f7-8a0c-052027c4b18c in Status: SUCCESS [ 1045.180710] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c587345b-51c8-42f7-8a0c-052027c4b18c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.181790] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cce60a92-c34e-445e-97a5-b8cfceb8b2b3 in Status: SUCCESS [ 1045.182070] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cce60a92-c34e-445e-97a5-b8cfceb8b2b3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.183282] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 97377310-5980-4d43-8124-617efecbd7fb in Status: SUCCESS [ 1045.183605] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-97377310-5980-4d43-8124-617efecbd7fb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.198100] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b95b4f27-41f6-4a01-a1aa-aa16348ad807 in Status: SUCCESS [ 1045.198623] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b95b4f27-41f6-4a01-a1aa-aa16348ad807" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.245661] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2e5973c-5504-4cd5-9f92-77ba0193d841 in Status: SUCCESS [ 1045.246022] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2e5973c-5504-4cd5-9f92-77ba0193d841 deletion is rescheduled due to dependency. [ 1045.246161] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.249440] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e in Status: SUCCESS [ 1045.249646] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.040958] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 in Status: SUCCESS [ 1046.040958] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 deletion is rescheduled due to dependency. [ 1046.041164] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.164735] env[65065]: INFO networking_nsxv3.common.synchronization [None req-f9354681-b5ab-497b-988f-81b2a7be48fc None None] Enqueued Resource ID: 8dd68f4f-7c8c-4464-bc58-b4d6cbed301f with Priority: HIGHEST for action port [ 1046.165281] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8dd68f4f-7c8c-4464-bc58-b4d6cbed301f with Priority: HIGHEST for action port [ 1046.165605] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-8dd68f4f-7c8c-4464-bc58-b4d6cbed301f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.165791] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8dd68f4f-7c8c-4464-bc58-b4d6cbed301f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.165791] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8dd68f4f-7c8c-4464-bc58-b4d6cbed301f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.166056] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8dd68f4f-7c8c-4464-bc58-b4d6cbed301f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.166141] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8dd68f4f-7c8c-4464-bc58-b4d6cbed301f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.252009] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 in Status: SUCCESS [ 1046.252375] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.252415] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.252625] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.252792] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.252906] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.252983] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.253118] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.253193] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.253274] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.253398] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1e5f0086-b1e3-4f00-8207-8306f153d0e4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.668635] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8dd68f4f-7c8c-4464-bc58-b4d6cbed301f [ 1046.669084] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.669084] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.669084] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.669338] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.669424] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.669523] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8dd68f4f-7c8c-4464-bc58-b4d6cbed301f already deleted. [ 1046.669603] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8dd68f4f-7c8c-4464-bc58-b4d6cbed301f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.755824] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e5f0086-b1e3-4f00-8207-8306f153d0e4 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.755989] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.756066] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.756281] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.756452] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.756565] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.756664] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.756813] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.756914] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.757013] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.757181] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e5f0086-b1e3-4f00-8207-8306f153d0e4 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.757286] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.757345] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.757507] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.757683] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.757841] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.757945] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.758197] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.758326] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.758478] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.758624] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1e5f0086-b1e3-4f00-8207-8306f153d0e4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.771806] env[65065]: INFO networking_nsxv3.common.synchronization [req-37ab2ba5-a745-4219-afe0-fe3988284db6 req-d8ba8420-2cd1-42c2-8105-43866852049c tempest-ServerActionsTestJSON-1279756280 tempest-ServerActionsTestJSON-1279756280-project-member] Enqueued Resource ID: c587345b-51c8-42f7-8a0c-052027c4b18c with Priority: HIGHEST for action security_group_members [ 1046.772666] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c587345b-51c8-42f7-8a0c-052027c4b18c with Priority: HIGHEST for action security_group_members [ 1046.772977] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-c587345b-51c8-42f7-8a0c-052027c4b18c taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.773111] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c587345b-51c8-42f7-8a0c-052027c4b18c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.773176] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c587345b-51c8-42f7-8a0c-052027c4b18c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.773362] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c587345b-51c8-42f7-8a0c-052027c4b18c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.773508] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.773605] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.773658] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.773799] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.773882] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.773992] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c587345b-51c8-42f7-8a0c-052027c4b18c',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.894095] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cce60a92-c34e-445e-97a5-b8cfceb8b2b3 in Status: SUCCESS [ 1046.894288] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cce60a92-c34e-445e-97a5-b8cfceb8b2b3 deletion is rescheduled due to dependency. [ 1046.894406] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cce60a92-c34e-445e-97a5-b8cfceb8b2b3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.262282] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1e5f0086-b1e3-4f00-8207-8306f153d0e4: rpc.has_security_group_logging(os_id): False [ 1047.276736] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.276736] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.276736] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.276736] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.276736] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.277112] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.277195] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.277195] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.277497] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.277497] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.277497] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c587345b-51c8-42f7-8a0c-052027c4b18c is going to be updated. [ 1047.280122] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.280352] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.280352] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.281472] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.303113] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.303113] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.303453] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.303453] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.303682] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.303682] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.303856] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.303856] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.303987] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.304049] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.304100] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.304335] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.304477] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.304477] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.304646] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.304646] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.305339] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 is going to be updated. [ 1047.316076] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.316076] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.316670] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.316670] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.316670] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.327665] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c587345b-51c8-42f7-8a0c-052027c4b18c in Status: IN_PROGRESS for 2s [ 1047.401755] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.401755] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.401755] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.401755] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.401755] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.423416] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 in Status: IN_PROGRESS for 2s [ 1049.339837] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c587345b-51c8-42f7-8a0c-052027c4b18c in Status: SUCCESS [ 1049.339837] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c587345b-51c8-42f7-8a0c-052027c4b18c deletion is rescheduled due to dependency. [ 1049.340196] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c587345b-51c8-42f7-8a0c-052027c4b18c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.443859] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 in Status: SUCCESS [ 1049.444117] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.228020] env[65065]: INFO networking_nsxv3.common.synchronization [req-5149911a-2384-4d56-85f6-72d27e575e6a req-660c826e-de9e-4238-8995-e98d886e186f tempest-ServersNegativeTestMultiTenantJSON-1630944362 tempest-ServersNegativeTestMultiTenantJSON-1630944362-project-member] Enqueued Resource ID: 74c38cdd-0fc2-4b37-a5aa-b743e142dc55 with Priority: HIGHEST for action security_group_members [ 1050.228020] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74c38cdd-0fc2-4b37-a5aa-b743e142dc55 with Priority: HIGHEST for action security_group_members [ 1050.228020] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-74c38cdd-0fc2-4b37-a5aa-b743e142dc55 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.228020] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-74c38cdd-0fc2-4b37-a5aa-b743e142dc55" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.228020] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-74c38cdd-0fc2-4b37-a5aa-b743e142dc55" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.228020] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-74c38cdd-0fc2-4b37-a5aa-b743e142dc55" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.228020] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.228020] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.228020] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.228020] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.228020] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.228020] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('74c38cdd-0fc2-4b37-a5aa-b743e142dc55',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.515850] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock network-676 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.515850] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "network-676" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.515850] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "network-676" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.516222] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "network-676" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.516501] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.516695] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.516833] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.517582] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.517864] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.518167] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1050.518351] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1050.518752] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1050.519017] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1050.519167] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1050.519317] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1050.519496] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1050.540138] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1050.540310] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1050.540452] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1050.540725] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "network-676" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.541098] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock port-e13a5531-c14f-4c6a-ae1c-47de6194c169 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.541278] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "port-e13a5531-c14f-4c6a-ae1c-47de6194c169" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.541397] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "port-e13a5531-c14f-4c6a-ae1c-47de6194c169" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.541742] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "port-e13a5531-c14f-4c6a-ae1c-47de6194c169" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.541880] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e13a5531-c14f-4c6a-ae1c-47de6194c169',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.731101] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.731101] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.731327] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.731426] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.731646] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.731938] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.732106] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.732182] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.732379] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.732494] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.732602] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 74c38cdd-0fc2-4b37-a5aa-b743e142dc55 already deleted. [ 1050.732734] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-74c38cdd-0fc2-4b37-a5aa-b743e142dc55" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.044707] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.047037] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.047037] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.047037] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.047037] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.047037] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Segment Port e13a5531-c14f-4c6a-ae1c-47de6194c169 not found, creating... [ 1051.047037] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.047037] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.047037] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.047037] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.047037] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.047523] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.047523] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.047523] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.047523] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.047523] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.047523] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Resource: SegmentPort with ID: e13a5531-c14f-4c6a-ae1c-47de6194c169 is going to be created. [ 1051.071272] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.071272] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.071272] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.071272] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.071620] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.071620] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "port-e13a5531-c14f-4c6a-ae1c-47de6194c169" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.796852] env[65065]: INFO networking_nsxv3.common.synchronization [req-5149911a-2384-4d56-85f6-72d27e575e6a req-cd9e5996-fafb-4222-bbbf-470b8e201d74 service nova] Enqueued Resource ID: 74c38cdd-0fc2-4b37-a5aa-b743e142dc55 with Priority: HIGHEST for action security_group_rules [ 1051.797159] env[65065]: INFO networking_nsxv3.common.synchronization [req-5149911a-2384-4d56-85f6-72d27e575e6a req-cd9e5996-fafb-4222-bbbf-470b8e201d74 service nova] Enqueued Resource ID: 74c38cdd-0fc2-4b37-a5aa-b743e142dc55 with Priority: HIGHEST for action security_group_members [ 1051.797159] env[65065]: INFO networking_nsxv3.common.synchronization [req-5149911a-2384-4d56-85f6-72d27e575e6a req-cd9e5996-fafb-4222-bbbf-470b8e201d74 service nova] Enqueued Resource ID: e13a5531-c14f-4c6a-ae1c-47de6194c169 with Priority: HIGHEST for action port [ 1051.797695] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74c38cdd-0fc2-4b37-a5aa-b743e142dc55 with Priority: HIGHEST for action security_group_rules [ 1051.797831] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74c38cdd-0fc2-4b37-a5aa-b743e142dc55 with Priority: HIGHEST for action security_group_members [ 1051.797953] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e13a5531-c14f-4c6a-ae1c-47de6194c169 with Priority: HIGHEST for action port [ 1051.798274] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-74c38cdd-0fc2-4b37-a5aa-b743e142dc55 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.798401] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-74c38cdd-0fc2-4b37-a5aa-b743e142dc55" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.798468] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-74c38cdd-0fc2-4b37-a5aa-b743e142dc55" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.798710] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-74c38cdd-0fc2-4b37-a5aa-b743e142dc55" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.798789] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('74c38cdd-0fc2-4b37-a5aa-b743e142dc55',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.800069] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-74c38cdd-0fc2-4b37-a5aa-b743e142dc55 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.800188] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-74c38cdd-0fc2-4b37-a5aa-b743e142dc55" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.800258] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-74c38cdd-0fc2-4b37-a5aa-b743e142dc55" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.800415] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-74c38cdd-0fc2-4b37-a5aa-b743e142dc55" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.800574] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.800673] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.800735] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.800871] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.800952] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.801051] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('74c38cdd-0fc2-4b37-a5aa-b743e142dc55',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.801758] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-e13a5531-c14f-4c6a-ae1c-47de6194c169 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.801866] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e13a5531-c14f-4c6a-ae1c-47de6194c169" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.801929] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e13a5531-c14f-4c6a-ae1c-47de6194c169" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.802500] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e13a5531-c14f-4c6a-ae1c-47de6194c169" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.802577] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e13a5531-c14f-4c6a-ae1c-47de6194c169',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.300635] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-74c38cdd-0fc2-4b37-a5aa-b743e142dc55 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.300801] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-74c38cdd-0fc2-4b37-a5aa-b743e142dc55" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.304235] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e13a5531-c14f-4c6a-ae1c-47de6194c169 with status ACTIVE [ 1052.304521] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.304687] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.304809] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.305085] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.305233] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.305481] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.305612] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.305767] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.305993] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.306097] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.306317] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.306414] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.306477] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.306633] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.306984] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.306984] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e13a5531-c14f-4c6a-ae1c-47de6194c169 is going to be updated. [ 1052.308021] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('74c38cdd-0fc2-4b37-a5aa-b743e142dc55',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.332174] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.332174] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.332174] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.332174] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.332367] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.332400] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e13a5531-c14f-4c6a-ae1c-47de6194c169" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.782207] env[65065]: INFO networking_nsxv3.common.synchronization [None req-f0563648-cec3-4e53-8670-9dad2bf97a32 tempest-AttachInterfacesTestJSON-1590270829 tempest-AttachInterfacesTestJSON-1590270829-project-member] Enqueued Resource ID: 54addcf5-1b30-4561-a83f-43a8cf610f46 with Priority: HIGHEST for action security_group_rules [ 1052.782739] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54addcf5-1b30-4561-a83f-43a8cf610f46 with Priority: HIGHEST for action security_group_rules [ 1052.783050] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-54addcf5-1b30-4561-a83f-43a8cf610f46 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.783175] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-54addcf5-1b30-4561-a83f-43a8cf610f46" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.783240] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-54addcf5-1b30-4561-a83f-43a8cf610f46" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.783491] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-54addcf5-1b30-4561-a83f-43a8cf610f46" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.783692] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('54addcf5-1b30-4561-a83f-43a8cf610f46',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.811821] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('74c38cdd-0fc2-4b37-a5aa-b743e142dc55',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.870340] env[65065]: INFO networking_nsxv3.common.synchronization [None req-079a9535-fb9f-47c1-8d64-1497d1ff8d1e tempest-AttachInterfacesTestJSON-1590270829 tempest-AttachInterfacesTestJSON-1590270829-project-member] Enqueued Resource ID: 54addcf5-1b30-4561-a83f-43a8cf610f46 with Priority: HIGHEST for action security_group_rules [ 1052.871779] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54addcf5-1b30-4561-a83f-43a8cf610f46 with Priority: HIGHEST for action security_group_rules [ 1052.871925] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-54addcf5-1b30-4561-a83f-43a8cf610f46 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.872055] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-54addcf5-1b30-4561-a83f-43a8cf610f46" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.260145] env[65065]: INFO networking_nsxv3.common.synchronization [req-f2c7072f-62e9-42b7-975c-9e2d97fe9a27 req-250cf34d-b6a4-4ff5-addc-d256242e49cb tempest-ServersTestJSON-1126920631 tempest-ServersTestJSON-1126920631-project-member] Enqueued Resource ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 with Priority: HIGHEST for action security_group_members [ 1053.260759] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 with Priority: HIGHEST for action security_group_members [ 1053.262372] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e5f0086-b1e3-4f00-8207-8306f153d0e4 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.262541] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.262632] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.262862] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.263066] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.263208] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.263294] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.263767] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.263976] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.264077] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e5f0086-b1e3-4f00-8207-8306f153d0e4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.308737] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.308927] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.309009] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.309242] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.309347] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.309446] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 54addcf5-1b30-4561-a83f-43a8cf610f46 already deleted. [ 1053.309601] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-54addcf5-1b30-4561-a83f-43a8cf610f46" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.309700] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-54addcf5-1b30-4561-a83f-43a8cf610f46" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.309961] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-54addcf5-1b30-4561-a83f-43a8cf610f46" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.310065] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('54addcf5-1b30-4561-a83f-43a8cf610f46',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.315211] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.315211] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.315211] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.315211] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.315211] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.315211] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 74c38cdd-0fc2-4b37-a5aa-b743e142dc55 is going to be created. [ 1053.339854] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.340328] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.340463] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.340730] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.340901] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.352623] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 74c38cdd-0fc2-4b37-a5aa-b743e142dc55 in Status: UNINITIALIZED for 2s [ 1053.766861] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1e5f0086-b1e3-4f00-8207-8306f153d0e4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.834365] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.834679] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.834679] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.834872] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.835233] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.835429] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 54addcf5-1b30-4561-a83f-43a8cf610f46 already deleted. [ 1053.835565] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-54addcf5-1b30-4561-a83f-43a8cf610f46" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.273683] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1e5f0086-b1e3-4f00-8207-8306f153d0e4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.776545] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.776827] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.776929] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.777187] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.777283] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.777376] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 is going to be updated. [ 1054.826162] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.826332] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.826383] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.827029] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.827029] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.835359] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 in Status: IN_PROGRESS for 2s [ 1055.363965] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 74c38cdd-0fc2-4b37-a5aa-b743e142dc55 in Status: SUCCESS [ 1055.363965] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-74c38cdd-0fc2-4b37-a5aa-b743e142dc55" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.363965] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-74c38cdd-0fc2-4b37-a5aa-b743e142dc55" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.364719] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-74c38cdd-0fc2-4b37-a5aa-b743e142dc55" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.364719] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.364719] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.364719] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.364719] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.364719] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.365095] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-74c38cdd-0fc2-4b37-a5aa-b743e142dc55" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.365095] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('74c38cdd-0fc2-4b37-a5aa-b743e142dc55',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.497140] env[65065]: INFO networking_nsxv3.common.synchronization [req-e4a4fd56-ae8d-4f81-8dfc-3a8a7fb2ba84 req-da6463da-4d1e-4702-9cac-377a716fad7c tempest-ServerActionsV293TestJSON-337812631 tempest-ServerActionsV293TestJSON-337812631-project-member] Enqueued Resource ID: 37c3f83a-5710-4c20-abeb-08e60639bed8 with Priority: HIGHEST for action security_group_members [ 1055.497670] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37c3f83a-5710-4c20-abeb-08e60639bed8 with Priority: HIGHEST for action security_group_members [ 1055.497970] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-37c3f83a-5710-4c20-abeb-08e60639bed8 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.498105] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37c3f83a-5710-4c20-abeb-08e60639bed8" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.498169] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37c3f83a-5710-4c20-abeb-08e60639bed8" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.498361] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37c3f83a-5710-4c20-abeb-08e60639bed8" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.498512] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.498624] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.498668] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.498808] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.498891] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.498980] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('37c3f83a-5710-4c20-abeb-08e60639bed8',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.870259] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-74c38cdd-0fc2-4b37-a5aa-b743e142dc55 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.870259] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-74c38cdd-0fc2-4b37-a5aa-b743e142dc55" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.870259] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-74c38cdd-0fc2-4b37-a5aa-b743e142dc55" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.870259] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-74c38cdd-0fc2-4b37-a5aa-b743e142dc55" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.870259] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.870259] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.870259] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.870259] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.870259] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.870259] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-74c38cdd-0fc2-4b37-a5aa-b743e142dc55" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.870259] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-74c38cdd-0fc2-4b37-a5aa-b743e142dc55 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.870259] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-74c38cdd-0fc2-4b37-a5aa-b743e142dc55" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.870259] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-74c38cdd-0fc2-4b37-a5aa-b743e142dc55" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.870259] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-74c38cdd-0fc2-4b37-a5aa-b743e142dc55" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.870259] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.870259] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.871252] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.871252] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.871252] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.871252] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-74c38cdd-0fc2-4b37-a5aa-b743e142dc55" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.871252] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('74c38cdd-0fc2-4b37-a5aa-b743e142dc55',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.002500] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.002500] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.002500] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.003060] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.028412] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.028412] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.028412] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.028412] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.028412] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.028412] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.028412] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37c3f83a-5710-4c20-abeb-08e60639bed8 is going to be updated. [ 1056.062030] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.062030] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.062030] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.062030] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.062030] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.073648] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37c3f83a-5710-4c20-abeb-08e60639bed8 in Status: IN_PROGRESS for 2s [ 1056.376679] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 74c38cdd-0fc2-4b37-a5aa-b743e142dc55: rpc.has_security_group_logging(os_id): False [ 1056.399487] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.399487] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.399487] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.399487] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.399487] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.399487] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.399487] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.399487] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.399487] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.399487] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.399487] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.399487] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.399487] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.399487] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.399487] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.400200] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.400200] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.400200] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.400200] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.400200] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.403885] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 74c38cdd-0fc2-4b37-a5aa-b743e142dc55 is going to be created. [ 1056.483523] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.483736] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.483736] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.484495] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.484495] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.495146] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 74c38cdd-0fc2-4b37-a5aa-b743e142dc55 in Status: IN_PROGRESS for 2s [ 1056.861593] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 in Status: SUCCESS [ 1056.862333] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.235777] env[65065]: INFO networking_nsxv3.common.synchronization [req-caf347e5-4788-487e-97e8-3e2e6bff2ac8 req-4dcacde0-73c4-4759-8f18-afee930e97b8 tempest-DeleteServersTestJSON-1316666736 tempest-DeleteServersTestJSON-1316666736-project-member] Enqueued Resource ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 with Priority: HIGHEST for action security_group_members [ 1057.236284] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 with Priority: HIGHEST for action security_group_members [ 1057.236610] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d0941d4-57d8-45e9-9f2f-95128b8136e5 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.236738] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.236807] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.237527] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.237784] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.238129] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.238129] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.238266] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.238360] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.238484] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d0941d4-57d8-45e9-9f2f-95128b8136e5',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.686299] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock network-950 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.686508] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "network-950" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.686629] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "network-950" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.686947] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "network-950" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.687225] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.687839] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.687839] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.687839] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.688020] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.688136] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1057.688270] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1057.688384] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1057.688509] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1057.688629] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1057.688713] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1057.688941] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1057.708161] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1057.708328] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1057.708462] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1057.708636] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "network-950" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.708956] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock port-5385c207-376c-4d25-84b9-3154ff56fcee taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.709135] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "port-5385c207-376c-4d25-84b9-3154ff56fcee" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.709250] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "port-5385c207-376c-4d25-84b9-3154ff56fcee" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.709566] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "port-5385c207-376c-4d25-84b9-3154ff56fcee" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.709701] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5385c207-376c-4d25-84b9-3154ff56fcee',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.743700] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.743967] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.743967] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.744131] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.744218] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.744414] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.744508] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.744566] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.744716] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.744787] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.744870] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 is going to be updated. [ 1057.768858] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.769050] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.769117] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.769296] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.769440] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.778991] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 in Status: IN_PROGRESS for 2s [ 1058.084967] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37c3f83a-5710-4c20-abeb-08e60639bed8 in Status: SUCCESS [ 1058.085135] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37c3f83a-5710-4c20-abeb-08e60639bed8 deletion is rescheduled due to dependency. [ 1058.086217] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37c3f83a-5710-4c20-abeb-08e60639bed8" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.212825] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.214210] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.214210] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.214210] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.214324] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.214482] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Segment Port 5385c207-376c-4d25-84b9-3154ff56fcee not found, creating... [ 1058.216040] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.216040] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.216040] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.216040] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.216040] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.216331] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.216331] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.216520] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.216592] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.216721] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.216864] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Resource: SegmentPort with ID: 5385c207-376c-4d25-84b9-3154ff56fcee is going to be created. [ 1058.242162] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.244100] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.244100] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.244100] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.244100] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.244100] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "port-5385c207-376c-4d25-84b9-3154ff56fcee" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.511525] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 74c38cdd-0fc2-4b37-a5aa-b743e142dc55 in Status: SUCCESS [ 1058.511836] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-74c38cdd-0fc2-4b37-a5aa-b743e142dc55" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.998442] env[65065]: INFO networking_nsxv3.common.synchronization [req-caf347e5-4788-487e-97e8-3e2e6bff2ac8 req-649fa8d5-decc-4efb-b694-fbad7a4bdd83 service nova] Enqueued Resource ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 with Priority: HIGHEST for action security_group_rules [ 1058.998629] env[65065]: INFO networking_nsxv3.common.synchronization [req-caf347e5-4788-487e-97e8-3e2e6bff2ac8 req-649fa8d5-decc-4efb-b694-fbad7a4bdd83 service nova] Enqueued Resource ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 with Priority: HIGHEST for action security_group_members [ 1058.998801] env[65065]: INFO networking_nsxv3.common.synchronization [req-caf347e5-4788-487e-97e8-3e2e6bff2ac8 req-649fa8d5-decc-4efb-b694-fbad7a4bdd83 service nova] Enqueued Resource ID: 5385c207-376c-4d25-84b9-3154ff56fcee with Priority: HIGHEST for action port [ 1058.999599] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 with Priority: HIGHEST for action security_group_rules [ 1058.999599] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 with Priority: HIGHEST for action security_group_members [ 1058.999599] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5385c207-376c-4d25-84b9-3154ff56fcee with Priority: HIGHEST for action port [ 1058.999794] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7d0941d4-57d8-45e9-9f2f-95128b8136e5 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.999912] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.999975] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.000258] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.000296] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7d0941d4-57d8-45e9-9f2f-95128b8136e5',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.001204] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d0941d4-57d8-45e9-9f2f-95128b8136e5 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.001274] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.001676] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-5385c207-376c-4d25-84b9-3154ff56fcee taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.001780] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5385c207-376c-4d25-84b9-3154ff56fcee" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.001922] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5385c207-376c-4d25-84b9-3154ff56fcee" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.002019] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5385c207-376c-4d25-84b9-3154ff56fcee" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.002096] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5385c207-376c-4d25-84b9-3154ff56fcee',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.504074] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d0941d4-57d8-45e9-9f2f-95128b8136e5 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.504074] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.504074] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5385c207-376c-4d25-84b9-3154ff56fcee with status ACTIVE [ 1059.504816] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.504816] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.504816] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.504816] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.504816] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.505073] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.505073] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.505073] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.505229] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.505229] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.505440] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.505588] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.505622] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.505758] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.505833] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.505925] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5385c207-376c-4d25-84b9-3154ff56fcee is going to be updated. [ 1059.526559] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.526674] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.526789] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.526985] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.527206] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.527401] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5385c207-376c-4d25-84b9-3154ff56fcee" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.790037] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 in Status: IN_PROGRESS for 4s [ 1061.800388] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 in Status: SUCCESS [ 1061.800779] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 deletion is rescheduled due to dependency. [ 1061.800836] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.800967] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.801196] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.801372] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.801513] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.801581] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.801732] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.801830] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.801934] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d0941d4-57d8-45e9-9f2f-95128b8136e5',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.305407] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7d0941d4-57d8-45e9-9f2f-95128b8136e5',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.810975] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7d0941d4-57d8-45e9-9f2f-95128b8136e5',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.313650] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.314511] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.314511] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.314511] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.314511] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.314511] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 is going to be updated. [ 1063.348069] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.348229] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.348509] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.348554] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.348701] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.361975] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 in Status: IN_PROGRESS for 2s [ 1063.587340] env[65065]: INFO networking_nsxv3.common.synchronization [req-a65d28c7-7f8b-40df-82ea-fd7f7458e033 req-837a86a3-1a31-4554-97b6-889fcf7b2564 tempest-ServerActionsTestOtherA-78922671 tempest-ServerActionsTestOtherA-78922671-project-member] Enqueued Resource ID: 42051b03-8b5b-4d44-b3bc-8b87353afdd7 with Priority: HIGHEST for action security_group_members [ 1063.587944] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42051b03-8b5b-4d44-b3bc-8b87353afdd7 with Priority: HIGHEST for action security_group_members [ 1063.589438] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-42051b03-8b5b-4d44-b3bc-8b87353afdd7 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.589594] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-42051b03-8b5b-4d44-b3bc-8b87353afdd7" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.589645] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-42051b03-8b5b-4d44-b3bc-8b87353afdd7" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.589874] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-42051b03-8b5b-4d44-b3bc-8b87353afdd7" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.590100] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.590190] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.590190] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.590332] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.590414] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.590521] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('42051b03-8b5b-4d44-b3bc-8b87353afdd7',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.082372] env[65065]: INFO networking_nsxv3.common.synchronization [req-5cc20ea1-25e5-4b95-b672-8d056e9ad70c req-4d4ab6e6-072c-4e81-ad0a-343b201f9dd7 tempest-ServersNegativeTestMultiTenantJSON-1630944362 tempest-ServersNegativeTestMultiTenantJSON-1630944362-project-member] Enqueued Resource ID: 74c38cdd-0fc2-4b37-a5aa-b743e142dc55 with Priority: HIGHEST for action security_group_members [ 1064.082900] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74c38cdd-0fc2-4b37-a5aa-b743e142dc55 with Priority: HIGHEST for action security_group_members [ 1064.083231] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-74c38cdd-0fc2-4b37-a5aa-b743e142dc55 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.083372] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-74c38cdd-0fc2-4b37-a5aa-b743e142dc55" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.083443] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-74c38cdd-0fc2-4b37-a5aa-b743e142dc55" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.083589] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-74c38cdd-0fc2-4b37-a5aa-b743e142dc55" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.084682] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.084682] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.084682] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.084682] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.084682] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.084682] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('74c38cdd-0fc2-4b37-a5aa-b743e142dc55',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.095343] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.095555] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.095615] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.095768] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.095854] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.096063] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.096164] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.096595] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.096791] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.096877] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.096968] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 42051b03-8b5b-4d44-b3bc-8b87353afdd7 is going to be updated. [ 1064.126442] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.126587] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.126634] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.126838] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.126974] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.136084] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 42051b03-8b5b-4d44-b3bc-8b87353afdd7 in Status: IN_PROGRESS for 2s [ 1064.138776] env[65065]: INFO networking_nsxv3.common.synchronization [req-b968f2ec-9262-463f-8ba0-1af161139541 req-af78459b-3333-47da-b580-34f1beb55a78 tempest-ServersTestJSON-1126920631 tempest-ServersTestJSON-1126920631-project-member] Enqueued Resource ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 with Priority: HIGHEST for action security_group_members [ 1064.139388] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 with Priority: HIGHEST for action security_group_members [ 1064.139725] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e5f0086-b1e3-4f00-8207-8306f153d0e4 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.139878] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.139929] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.140128] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.140284] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.140382] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.140445] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.140595] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.140680] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.140820] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e5f0086-b1e3-4f00-8207-8306f153d0e4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.588448] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.588448] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.588448] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.588719] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.588719] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.588949] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.589095] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.589169] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.589294] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.589404] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.589524] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 74c38cdd-0fc2-4b37-a5aa-b743e142dc55 is going to be updated. [ 1064.621773] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.621955] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.621955] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.622137] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.623275] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.632262] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 74c38cdd-0fc2-4b37-a5aa-b743e142dc55 in Status: IN_PROGRESS for 2s [ 1064.643792] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1e5f0086-b1e3-4f00-8207-8306f153d0e4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.660639] env[65065]: INFO networking_nsxv3.common.synchronization [req-47def96f-cc1e-4e2e-953d-a6c782ef1437 req-82e55c7f-6455-4691-be25-69d1a2182d77 tempest-AttachInterfacesTestJSON-1590270829 tempest-AttachInterfacesTestJSON-1590270829-project-member] Enqueued Resource ID: 54addcf5-1b30-4561-a83f-43a8cf610f46 with Priority: HIGHEST for action security_group_members [ 1064.661471] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54addcf5-1b30-4561-a83f-43a8cf610f46 with Priority: HIGHEST for action security_group_members [ 1064.661864] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-54addcf5-1b30-4561-a83f-43a8cf610f46 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.661988] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54addcf5-1b30-4561-a83f-43a8cf610f46" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.662418] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54addcf5-1b30-4561-a83f-43a8cf610f46" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.662418] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54addcf5-1b30-4561-a83f-43a8cf610f46" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.662589] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.662682] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.662682] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.664675] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.664675] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.664675] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('54addcf5-1b30-4561-a83f-43a8cf610f46',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.025801] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock network-688 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.026040] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "network-688" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.026173] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "network-688" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.026412] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "network-688" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.026666] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.026821] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.026936] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.027278] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.027447] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.027662] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1065.027776] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1065.027890] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1065.028056] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1065.028249] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1065.028388] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1065.028525] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1065.048641] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1065.049154] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1065.049327] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1065.049509] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "network-688" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.049872] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock port-4ea363bc-4f9d-49a9-af4e-ee62560ff36f taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.050101] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "port-4ea363bc-4f9d-49a9-af4e-ee62560ff36f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.050227] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "port-4ea363bc-4f9d-49a9-af4e-ee62560ff36f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.050682] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "port-4ea363bc-4f9d-49a9-af4e-ee62560ff36f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.050928] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4ea363bc-4f9d-49a9-af4e-ee62560ff36f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.146478] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1e5f0086-b1e3-4f00-8207-8306f153d0e4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.165870] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.165870] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.165870] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.166244] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.166244] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.166407] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.166488] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.167094] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.167094] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.167094] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.167094] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54addcf5-1b30-4561-a83f-43a8cf610f46 already deleted. [ 1065.167094] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54addcf5-1b30-4561-a83f-43a8cf610f46" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.370708] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 in Status: SUCCESS [ 1065.370960] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.371159] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.371371] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.371566] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.371683] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.371743] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.371894] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.371980] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.372065] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.372159] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7d0941d4-57d8-45e9-9f2f-95128b8136e5',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.554657] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.554899] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.555037] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.555314] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.555474] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.555634] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Segment Port 4ea363bc-4f9d-49a9-af4e-ee62560ff36f not found, creating... [ 1065.555903] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.556050] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.556195] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.556385] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.556552] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.556812] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.556966] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.557237] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.557491] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.557655] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.557823] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Resource: SegmentPort with ID: 4ea363bc-4f9d-49a9-af4e-ee62560ff36f is going to be created. [ 1065.581711] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.581967] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.582112] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.582404] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.582618] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.582845] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "port-4ea363bc-4f9d-49a9-af4e-ee62560ff36f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.649725] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.649955] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.650060] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.650420] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.650596] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.650832] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 is going to be updated. [ 1065.705599] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.705599] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.705599] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.705599] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.705599] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.719535] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 in Status: IN_PROGRESS for 2s [ 1065.874590] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d0941d4-57d8-45e9-9f2f-95128b8136e5 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.874814] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.874865] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.875120] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.875286] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.875385] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.875448] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.875597] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.875684] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.875793] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.875911] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d0941d4-57d8-45e9-9f2f-95128b8136e5 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.875998] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.876057] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.876358] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.876358] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.876461] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.876509] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.876663] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.876736] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.876817] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.876907] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7d0941d4-57d8-45e9-9f2f-95128b8136e5',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.148901] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 42051b03-8b5b-4d44-b3bc-8b87353afdd7 in Status: SUCCESS [ 1066.149257] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 42051b03-8b5b-4d44-b3bc-8b87353afdd7 deletion is rescheduled due to dependency. [ 1066.149257] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-42051b03-8b5b-4d44-b3bc-8b87353afdd7" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.282306] env[65065]: INFO networking_nsxv3.common.synchronization [req-47def96f-cc1e-4e2e-953d-a6c782ef1437 req-71f0390c-4315-4590-b59a-1627090d8cd4 service nova] Enqueued Resource ID: 54addcf5-1b30-4561-a83f-43a8cf610f46 with Priority: HIGHEST for action security_group_rules [ 1066.282306] env[65065]: INFO networking_nsxv3.common.synchronization [req-47def96f-cc1e-4e2e-953d-a6c782ef1437 req-71f0390c-4315-4590-b59a-1627090d8cd4 service nova] Enqueued Resource ID: 54addcf5-1b30-4561-a83f-43a8cf610f46 with Priority: HIGHEST for action security_group_members [ 1066.282306] env[65065]: INFO networking_nsxv3.common.synchronization [req-47def96f-cc1e-4e2e-953d-a6c782ef1437 req-71f0390c-4315-4590-b59a-1627090d8cd4 service nova] Enqueued Resource ID: 4ea363bc-4f9d-49a9-af4e-ee62560ff36f with Priority: HIGHEST for action port [ 1066.282306] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54addcf5-1b30-4561-a83f-43a8cf610f46 with Priority: HIGHEST for action security_group_rules [ 1066.282306] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54addcf5-1b30-4561-a83f-43a8cf610f46 with Priority: HIGHEST for action security_group_members [ 1066.282306] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ea363bc-4f9d-49a9-af4e-ee62560ff36f with Priority: HIGHEST for action port [ 1066.282306] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-54addcf5-1b30-4561-a83f-43a8cf610f46 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.284795] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-54addcf5-1b30-4561-a83f-43a8cf610f46" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.284907] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-54addcf5-1b30-4561-a83f-43a8cf610f46" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.285114] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-54addcf5-1b30-4561-a83f-43a8cf610f46" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.285202] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('54addcf5-1b30-4561-a83f-43a8cf610f46',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.286080] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-54addcf5-1b30-4561-a83f-43a8cf610f46 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.286200] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54addcf5-1b30-4561-a83f-43a8cf610f46" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.286267] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54addcf5-1b30-4561-a83f-43a8cf610f46" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.286435] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54addcf5-1b30-4561-a83f-43a8cf610f46" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.286585] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.286677] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.286738] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.286873] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.286956] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.287056] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('54addcf5-1b30-4561-a83f-43a8cf610f46',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.287799] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-4ea363bc-4f9d-49a9-af4e-ee62560ff36f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.287905] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4ea363bc-4f9d-49a9-af4e-ee62560ff36f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.287971] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4ea363bc-4f9d-49a9-af4e-ee62560ff36f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.288808] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4ea363bc-4f9d-49a9-af4e-ee62560ff36f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.288895] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4ea363bc-4f9d-49a9-af4e-ee62560ff36f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.379858] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7d0941d4-57d8-45e9-9f2f-95128b8136e5: rpc.has_security_group_logging(os_id): False [ 1066.398181] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.398382] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.398495] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.398741] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.398887] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.399153] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.399387] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.399387] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.399549] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.399653] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.399865] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.399994] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.400089] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.400325] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.400325] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.400484] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.400574] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.400634] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.400806] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.400912] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.400998] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 is going to be updated. [ 1066.468090] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.468090] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.468090] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.468090] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.468417] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.483605] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 in Status: IN_PROGRESS for 2s [ 1066.642065] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 74c38cdd-0fc2-4b37-a5aa-b743e142dc55 in Status: SUCCESS [ 1066.642065] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 74c38cdd-0fc2-4b37-a5aa-b743e142dc55 deletion is rescheduled due to dependency. [ 1066.642633] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-74c38cdd-0fc2-4b37-a5aa-b743e142dc55" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.791182] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-54addcf5-1b30-4561-a83f-43a8cf610f46 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.791429] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54addcf5-1b30-4561-a83f-43a8cf610f46" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.791553] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('54addcf5-1b30-4561-a83f-43a8cf610f46',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.792617] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4ea363bc-4f9d-49a9-af4e-ee62560ff36f with status ACTIVE [ 1066.793319] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.793453] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.793542] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.794664] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.794664] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.794664] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.794664] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.794664] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.794664] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.794664] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.795196] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.795196] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.795196] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.795196] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.795358] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.795358] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4ea363bc-4f9d-49a9-af4e-ee62560ff36f is going to be updated. [ 1066.822587] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.822833] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.822893] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.823226] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.823403] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.823625] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4ea363bc-4f9d-49a9-af4e-ee62560ff36f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.936435] env[65065]: INFO networking_nsxv3.common.synchronization [req-9ca15c85-5dbf-40a4-a7ae-847c82474b19 req-fc8f9365-b201-4ef1-88ef-1cd165ca214e tempest-ServerActionsTestJSON-1279756280 tempest-ServerActionsTestJSON-1279756280-project-member] Enqueued Resource ID: c587345b-51c8-42f7-8a0c-052027c4b18c with Priority: HIGHEST for action security_group_members [ 1066.937227] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c587345b-51c8-42f7-8a0c-052027c4b18c with Priority: HIGHEST for action security_group_members [ 1066.937596] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-c587345b-51c8-42f7-8a0c-052027c4b18c taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.937750] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c587345b-51c8-42f7-8a0c-052027c4b18c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.938169] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c587345b-51c8-42f7-8a0c-052027c4b18c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.939931] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c587345b-51c8-42f7-8a0c-052027c4b18c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.939931] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.939931] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.939931] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.939931] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.941203] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.941203] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c587345b-51c8-42f7-8a0c-052027c4b18c',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.231476] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock network-502 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.231837] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "network-502" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.231951] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "network-502" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.232204] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "network-502" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.232461] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.232615] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.232803] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.232937] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.233270] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.233524] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1067.233666] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1067.233802] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1067.233935] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1067.234080] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1067.234218] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1067.234373] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1067.254133] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1067.254355] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1067.254527] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1067.255480] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "network-502" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.255800] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock port-9ee2477b-9740-4fe4-928d-74c23a0556ba taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.255994] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "port-9ee2477b-9740-4fe4-928d-74c23a0556ba" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.256143] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "port-9ee2477b-9740-4fe4-928d-74c23a0556ba" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.256641] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "port-9ee2477b-9740-4fe4-928d-74c23a0556ba" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.256641] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9ee2477b-9740-4fe4-928d-74c23a0556ba',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.297532] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('54addcf5-1b30-4561-a83f-43a8cf610f46',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.442827] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.442986] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.443067] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.443392] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.443507] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.443755] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.443863] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.443932] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.444102] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.444180] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.444267] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c587345b-51c8-42f7-8a0c-052027c4b18c is going to be updated. [ 1067.474535] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.474708] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.474750] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.474960] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.475111] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.483410] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c587345b-51c8-42f7-8a0c-052027c4b18c in Status: IN_PROGRESS for 2s [ 1067.547727] env[65065]: INFO networking_nsxv3.common.synchronization [req-324fa86e-9008-4288-ac96-c19f422bb32c req-b8c16e6e-7b7e-446a-b699-112090a0692b tempest-ServerActionsTestOtherB-1640131964 tempest-ServerActionsTestOtherB-1640131964-project-member] Enqueued Resource ID: b95b4f27-41f6-4a01-a1aa-aa16348ad807 with Priority: HIGHEST for action security_group_members [ 1067.548289] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b95b4f27-41f6-4a01-a1aa-aa16348ad807 with Priority: HIGHEST for action security_group_members [ 1067.548600] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-b95b4f27-41f6-4a01-a1aa-aa16348ad807 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.548744] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b95b4f27-41f6-4a01-a1aa-aa16348ad807" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.548841] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b95b4f27-41f6-4a01-a1aa-aa16348ad807" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.549065] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b95b4f27-41f6-4a01-a1aa-aa16348ad807" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.549226] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.549331] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.549393] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.549546] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.549632] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.549727] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b95b4f27-41f6-4a01-a1aa-aa16348ad807',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.729892] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 in Status: SUCCESS [ 1067.729892] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.758684] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.758965] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.759110] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.759395] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.759581] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.759742] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Segment Port 9ee2477b-9740-4fe4-928d-74c23a0556ba not found, creating... [ 1067.760149] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.760274] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.760413] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.760675] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.760887] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.761218] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.761379] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.761496] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.762206] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.762206] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.762335] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Resource: SegmentPort with ID: 9ee2477b-9740-4fe4-928d-74c23a0556ba is going to be created. [ 1067.783484] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.783484] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.783484] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.783484] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.783484] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.783484] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "port-9ee2477b-9740-4fe4-928d-74c23a0556ba" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.800225] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.800441] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.800576] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.801161] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.801342] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.801342] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54addcf5-1b30-4561-a83f-43a8cf610f46 is going to be created. [ 1067.867313] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.867313] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.867313] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.867616] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.867616] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.890913] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54addcf5-1b30-4561-a83f-43a8cf610f46 in Status: UNINITIALIZED for 2s [ 1068.051420] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.051647] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.051709] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.051942] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.052061] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.052262] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.052365] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.052410] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.052568] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.052642] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.052728] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b95b4f27-41f6-4a01-a1aa-aa16348ad807 is going to be updated. [ 1068.079717] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.079859] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.079931] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.080149] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.080288] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.090125] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b95b4f27-41f6-4a01-a1aa-aa16348ad807 in Status: IN_PROGRESS for 2s [ 1068.486247] env[65065]: INFO networking_nsxv3.common.synchronization [req-9ca15c85-5dbf-40a4-a7ae-847c82474b19 req-7cf1a6ca-2636-4106-abd4-3d0622758beb service nova] Enqueued Resource ID: c587345b-51c8-42f7-8a0c-052027c4b18c with Priority: HIGHEST for action security_group_rules [ 1068.486507] env[65065]: INFO networking_nsxv3.common.synchronization [req-9ca15c85-5dbf-40a4-a7ae-847c82474b19 req-7cf1a6ca-2636-4106-abd4-3d0622758beb service nova] Enqueued Resource ID: c587345b-51c8-42f7-8a0c-052027c4b18c with Priority: HIGHEST for action security_group_members [ 1068.488099] env[65065]: INFO networking_nsxv3.common.synchronization [req-9ca15c85-5dbf-40a4-a7ae-847c82474b19 req-7cf1a6ca-2636-4106-abd4-3d0622758beb service nova] Enqueued Resource ID: 9ee2477b-9740-4fe4-928d-74c23a0556ba with Priority: HIGHEST for action port [ 1068.488751] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c587345b-51c8-42f7-8a0c-052027c4b18c with Priority: HIGHEST for action security_group_rules [ 1068.488925] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c587345b-51c8-42f7-8a0c-052027c4b18c with Priority: HIGHEST for action security_group_members [ 1068.489049] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ee2477b-9740-4fe4-928d-74c23a0556ba with Priority: HIGHEST for action port [ 1068.489714] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c587345b-51c8-42f7-8a0c-052027c4b18c taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.489847] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c587345b-51c8-42f7-8a0c-052027c4b18c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.489893] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c587345b-51c8-42f7-8a0c-052027c4b18c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.490109] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c587345b-51c8-42f7-8a0c-052027c4b18c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.490189] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c587345b-51c8-42f7-8a0c-052027c4b18c',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.491121] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-c587345b-51c8-42f7-8a0c-052027c4b18c taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.491242] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c587345b-51c8-42f7-8a0c-052027c4b18c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.491415] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-9ee2477b-9740-4fe4-928d-74c23a0556ba taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.491526] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9ee2477b-9740-4fe4-928d-74c23a0556ba" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.491598] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9ee2477b-9740-4fe4-928d-74c23a0556ba" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.491741] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9ee2477b-9740-4fe4-928d-74c23a0556ba" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.491816] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9ee2477b-9740-4fe4-928d-74c23a0556ba',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.502854] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 in Status: SUCCESS [ 1068.503081] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.994181] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-c587345b-51c8-42f7-8a0c-052027c4b18c taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.994425] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c587345b-51c8-42f7-8a0c-052027c4b18c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.994569] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9ee2477b-9740-4fe4-928d-74c23a0556ba with status ACTIVE [ 1068.994738] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.994996] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.994996] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.995864] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.995864] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.995864] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.995864] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.995864] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.995864] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.995864] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.996270] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.996270] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.996270] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.996442] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.996511] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.996622] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9ee2477b-9740-4fe4-928d-74c23a0556ba is going to be updated. [ 1069.024443] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.024679] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.024790] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.025117] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.025331] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.025591] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9ee2477b-9740-4fe4-928d-74c23a0556ba" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.495561] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c587345b-51c8-42f7-8a0c-052027c4b18c in Status: SUCCESS [ 1069.495876] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c587345b-51c8-42f7-8a0c-052027c4b18c deletion is rescheduled due to dependency. [ 1069.495876] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c587345b-51c8-42f7-8a0c-052027c4b18c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.496063] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c587345b-51c8-42f7-8a0c-052027c4b18c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.496303] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c587345b-51c8-42f7-8a0c-052027c4b18c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.496617] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.496775] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.496883] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.497120] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.497235] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.497344] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c587345b-51c8-42f7-8a0c-052027c4b18c',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.901470] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54addcf5-1b30-4561-a83f-43a8cf610f46 in Status: SUCCESS [ 1069.901777] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54addcf5-1b30-4561-a83f-43a8cf610f46" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.902016] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54addcf5-1b30-4561-a83f-43a8cf610f46" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.902328] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54addcf5-1b30-4561-a83f-43a8cf610f46" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.902602] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.902776] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.902879] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.903116] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.903239] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.903368] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54addcf5-1b30-4561-a83f-43a8cf610f46" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.903511] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('54addcf5-1b30-4561-a83f-43a8cf610f46',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.999981] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c587345b-51c8-42f7-8a0c-052027c4b18c',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.102510] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b95b4f27-41f6-4a01-a1aa-aa16348ad807 in Status: SUCCESS [ 1070.102717] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b95b4f27-41f6-4a01-a1aa-aa16348ad807 deletion is rescheduled due to dependency. [ 1070.102857] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b95b4f27-41f6-4a01-a1aa-aa16348ad807" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.405817] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('54addcf5-1b30-4561-a83f-43a8cf610f46',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.503084] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c587345b-51c8-42f7-8a0c-052027c4b18c',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.907828] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 54addcf5-1b30-4561-a83f-43a8cf610f46: rpc.has_security_group_logging(os_id): False [ 1070.927419] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.927580] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.927625] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.927848] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.927935] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.928186] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.928325] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.928392] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.928575] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.928651] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.928741] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 54addcf5-1b30-4561-a83f-43a8cf610f46 is going to be created. [ 1070.997438] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.997654] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.997695] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.997948] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.998243] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.005291] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.005487] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.005596] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.005867] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.006014] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.006135] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c587345b-51c8-42f7-8a0c-052027c4b18c is going to be updated. [ 1071.010452] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 54addcf5-1b30-4561-a83f-43a8cf610f46 in Status: IN_PROGRESS for 2s [ 1071.038104] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.038369] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.038369] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.038534] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.038713] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.052805] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c587345b-51c8-42f7-8a0c-052027c4b18c in Status: IN_PROGRESS for 2s [ 1071.763986] env[65065]: INFO networking_nsxv3.common.synchronization [None req-3b7939ee-7000-4ab8-a5db-4a383975f1d0 tempest-ServerActionsTestOtherA-78922671 tempest-ServerActionsTestOtherA-78922671-project-member] Enqueued Resource ID: 8356bfa0-0d42-40e4-bec9-fd902715779f with Priority: HIGHEST for action security_group_rules [ 1071.764770] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8356bfa0-0d42-40e4-bec9-fd902715779f with Priority: HIGHEST for action security_group_rules [ 1071.764909] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8356bfa0-0d42-40e4-bec9-fd902715779f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.765096] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8356bfa0-0d42-40e4-bec9-fd902715779f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.765185] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8356bfa0-0d42-40e4-bec9-fd902715779f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.765444] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8356bfa0-0d42-40e4-bec9-fd902715779f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.765529] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8356bfa0-0d42-40e4-bec9-fd902715779f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.854506] env[65065]: INFO networking_nsxv3.common.synchronization [None req-682edcfd-26e7-4237-a0df-6b3f387b82a0 tempest-ServerActionsTestOtherA-78922671 tempest-ServerActionsTestOtherA-78922671-project-member] Enqueued Resource ID: 8356bfa0-0d42-40e4-bec9-fd902715779f with Priority: HIGHEST for action security_group_rules [ 1071.855080] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8356bfa0-0d42-40e4-bec9-fd902715779f with Priority: HIGHEST for action security_group_rules [ 1071.855457] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8356bfa0-0d42-40e4-bec9-fd902715779f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.855562] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8356bfa0-0d42-40e4-bec9-fd902715779f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.286975] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.287170] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.287238] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.287497] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.287607] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.287703] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8356bfa0-0d42-40e4-bec9-fd902715779f already deleted. [ 1072.287846] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8356bfa0-0d42-40e4-bec9-fd902715779f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.287933] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8356bfa0-0d42-40e4-bec9-fd902715779f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.288104] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8356bfa0-0d42-40e4-bec9-fd902715779f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.288197] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8356bfa0-0d42-40e4-bec9-fd902715779f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.820648] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.820648] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.820648] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.820648] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.820648] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.820648] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8356bfa0-0d42-40e4-bec9-fd902715779f already deleted. [ 1072.820648] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8356bfa0-0d42-40e4-bec9-fd902715779f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.025387] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 54addcf5-1b30-4561-a83f-43a8cf610f46 in Status: SUCCESS [ 1073.025642] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-54addcf5-1b30-4561-a83f-43a8cf610f46" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.063976] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c587345b-51c8-42f7-8a0c-052027c4b18c in Status: SUCCESS [ 1073.064221] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c587345b-51c8-42f7-8a0c-052027c4b18c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.064393] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c587345b-51c8-42f7-8a0c-052027c4b18c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.064608] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c587345b-51c8-42f7-8a0c-052027c4b18c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.064800] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.064918] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.064983] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.065149] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.065227] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.065313] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c587345b-51c8-42f7-8a0c-052027c4b18c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.065406] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c587345b-51c8-42f7-8a0c-052027c4b18c',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.567347] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c587345b-51c8-42f7-8a0c-052027c4b18c',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.070719] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c587345b-51c8-42f7-8a0c-052027c4b18c: rpc.has_security_group_logging(os_id): False [ 1074.091324] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.091506] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.091573] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.092561] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.092561] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.092561] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.092561] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.092561] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.092950] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.092950] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.092950] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c587345b-51c8-42f7-8a0c-052027c4b18c is going to be updated. [ 1074.179547] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.179547] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.179547] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.179547] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.179547] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.212701] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c587345b-51c8-42f7-8a0c-052027c4b18c in Status: IN_PROGRESS for 2s [ 1076.230496] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c587345b-51c8-42f7-8a0c-052027c4b18c in Status: SUCCESS [ 1076.230496] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c587345b-51c8-42f7-8a0c-052027c4b18c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.856653] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1076.856653] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1081.353590] env[65065]: INFO networking_nsxv3.common.synchronization [req-76a75b54-d684-4bf4-821f-770f4916f8b3 req-9c7e3cc7-63f9-4ffb-abba-150cfa551f80 tempest-ServerActionsTestOtherA-78922671 tempest-ServerActionsTestOtherA-78922671-project-member] Enqueued Resource ID: 8356bfa0-0d42-40e4-bec9-fd902715779f with Priority: HIGHEST for action security_group_members [ 1081.354275] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8356bfa0-0d42-40e4-bec9-fd902715779f with Priority: HIGHEST for action security_group_members [ 1081.354685] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-8356bfa0-0d42-40e4-bec9-fd902715779f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.354754] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8356bfa0-0d42-40e4-bec9-fd902715779f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.354825] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8356bfa0-0d42-40e4-bec9-fd902715779f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.355281] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8356bfa0-0d42-40e4-bec9-fd902715779f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.355475] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.355611] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.355924] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.355924] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.355984] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.356102] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8356bfa0-0d42-40e4-bec9-fd902715779f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.711086] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock network-33 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.711308] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "network-33" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.711431] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "network-33" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.711699] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "network-33" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.711961] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.712314] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.712444] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.712665] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.712808] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.713022] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1081.713135] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1081.713246] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1081.713381] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1081.713502] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1081.713630] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1081.713784] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1081.734062] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1081.734248] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1081.734388] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1081.734561] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "network-33" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.734868] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock port-94cb80ff-9ec9-433f-a05c-0503acf1ae9d taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.735051] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "port-94cb80ff-9ec9-433f-a05c-0503acf1ae9d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.735172] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "port-94cb80ff-9ec9-433f-a05c-0503acf1ae9d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.735495] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "port-94cb80ff-9ec9-433f-a05c-0503acf1ae9d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.735632] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('94cb80ff-9ec9-433f-a05c-0503acf1ae9d',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.858736] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.858924] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.858959] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.859370] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.859518] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.859744] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.859909] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.860030] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.860266] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.860361] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.860450] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8356bfa0-0d42-40e4-bec9-fd902715779f already deleted. [ 1081.860639] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8356bfa0-0d42-40e4-bec9-fd902715779f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.238364] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.238643] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.238893] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.239322] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.239483] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.239637] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Segment Port 94cb80ff-9ec9-433f-a05c-0503acf1ae9d not found, creating... [ 1082.239989] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.240314] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.240535] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.240800] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.240949] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.241321] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.241486] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.241603] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.241813] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.241947] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.242100] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Resource: SegmentPort with ID: 94cb80ff-9ec9-433f-a05c-0503acf1ae9d is going to be created. [ 1082.266965] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.267267] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.267330] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.267642] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.267873] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.268119] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "port-94cb80ff-9ec9-433f-a05c-0503acf1ae9d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.991021] env[65065]: INFO networking_nsxv3.common.synchronization [req-76a75b54-d684-4bf4-821f-770f4916f8b3 req-a39a2285-80a5-4fdc-9db2-598f1d7d4eef service nova] Enqueued Resource ID: 8356bfa0-0d42-40e4-bec9-fd902715779f with Priority: HIGHEST for action security_group_rules [ 1082.991021] env[65065]: INFO networking_nsxv3.common.synchronization [req-76a75b54-d684-4bf4-821f-770f4916f8b3 req-a39a2285-80a5-4fdc-9db2-598f1d7d4eef service nova] Enqueued Resource ID: 8356bfa0-0d42-40e4-bec9-fd902715779f with Priority: HIGHEST for action security_group_members [ 1082.991021] env[65065]: INFO networking_nsxv3.common.synchronization [req-76a75b54-d684-4bf4-821f-770f4916f8b3 req-a39a2285-80a5-4fdc-9db2-598f1d7d4eef service nova] Enqueued Resource ID: 94cb80ff-9ec9-433f-a05c-0503acf1ae9d with Priority: HIGHEST for action port [ 1082.991021] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8356bfa0-0d42-40e4-bec9-fd902715779f with Priority: HIGHEST for action security_group_rules [ 1082.991021] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8356bfa0-0d42-40e4-bec9-fd902715779f with Priority: HIGHEST for action security_group_members [ 1082.991021] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94cb80ff-9ec9-433f-a05c-0503acf1ae9d with Priority: HIGHEST for action port [ 1082.992032] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8356bfa0-0d42-40e4-bec9-fd902715779f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.992788] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8356bfa0-0d42-40e4-bec9-fd902715779f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.993043] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8356bfa0-0d42-40e4-bec9-fd902715779f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.993315] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8356bfa0-0d42-40e4-bec9-fd902715779f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.993536] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8356bfa0-0d42-40e4-bec9-fd902715779f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.994773] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-8356bfa0-0d42-40e4-bec9-fd902715779f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.994773] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8356bfa0-0d42-40e4-bec9-fd902715779f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.994861] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8356bfa0-0d42-40e4-bec9-fd902715779f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.995320] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8356bfa0-0d42-40e4-bec9-fd902715779f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.995320] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.995456] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.995501] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.995635] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.995710] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.995821] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8356bfa0-0d42-40e4-bec9-fd902715779f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.996601] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-94cb80ff-9ec9-433f-a05c-0503acf1ae9d taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.996999] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-94cb80ff-9ec9-433f-a05c-0503acf1ae9d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.996999] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-94cb80ff-9ec9-433f-a05c-0503acf1ae9d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.996999] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-94cb80ff-9ec9-433f-a05c-0503acf1ae9d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.997732] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('94cb80ff-9ec9-433f-a05c-0503acf1ae9d',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.499755] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-8356bfa0-0d42-40e4-bec9-fd902715779f taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.499881] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8356bfa0-0d42-40e4-bec9-fd902715779f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.500085] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8356bfa0-0d42-40e4-bec9-fd902715779f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.500940] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 94cb80ff-9ec9-433f-a05c-0503acf1ae9d with status ACTIVE [ 1083.501209] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.501334] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.501378] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.501579] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.501668] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.501838] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.501955] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.501985] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.502180] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.502256] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.502435] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.502590] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.502590] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.503425] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.503425] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.503425] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 94cb80ff-9ec9-433f-a05c-0503acf1ae9d is going to be updated. [ 1083.523849] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.523849] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.523849] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.524035] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.524197] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.524382] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-94cb80ff-9ec9-433f-a05c-0503acf1ae9d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.625122] env[65065]: INFO networking_nsxv3.common.synchronization [req-7e6c143e-6c2c-4ac7-a61f-5c29358b0c70 req-e010869a-c2ca-4b37-ba88-8301dc7e35ce tempest-ServersTestJSON-1126920631 tempest-ServersTestJSON-1126920631-project-member] Enqueued Resource ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 with Priority: HIGHEST for action security_group_members [ 1083.625695] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 with Priority: HIGHEST for action security_group_members [ 1083.626114] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e5f0086-b1e3-4f00-8207-8306f153d0e4 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.626451] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.626451] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.626591] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.626703] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.626794] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.626851] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.627016] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.627110] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.627304] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e5f0086-b1e3-4f00-8207-8306f153d0e4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.991514] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock network-381 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.992029] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "network-381" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.992296] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "network-381" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.992700] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "network-381" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.993161] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.993446] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.993675] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.994064] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.994352] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.994924] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1083.995147] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1083.995393] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1083.995642] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1083.995912] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1083.996215] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1083.996470] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1084.005256] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8356bfa0-0d42-40e4-bec9-fd902715779f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.034348] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1084.034629] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Cache value generated in 0.038 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1084.034791] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1084.034968] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "network-381" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.035479] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock port-43b7f58b-b27e-402c-8e8c-d9868e99c2df taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.035687] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "port-43b7f58b-b27e-402c-8e8c-d9868e99c2df" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.035811] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "port-43b7f58b-b27e-402c-8e8c-d9868e99c2df" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.036308] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "port-43b7f58b-b27e-402c-8e8c-d9868e99c2df" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.036405] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('43b7f58b-b27e-402c-8e8c-d9868e99c2df',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.130799] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1e5f0086-b1e3-4f00-8207-8306f153d0e4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.508275] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.508466] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.508572] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.508854] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.508952] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.509091] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8356bfa0-0d42-40e4-bec9-fd902715779f is going to be created. [ 1084.531615] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.531779] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.531818] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.532015] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.532207] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.538900] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.539195] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.539349] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.539610] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.539748] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.539907] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Segment Port 43b7f58b-b27e-402c-8e8c-d9868e99c2df not found, creating... [ 1084.540172] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.540329] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.540458] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.540671] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.540804] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.541123] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.541294] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.541411] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.541614] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.541743] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.541878] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Resource: SegmentPort with ID: 43b7f58b-b27e-402c-8e8c-d9868e99c2df is going to be created. [ 1084.543465] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8356bfa0-0d42-40e4-bec9-fd902715779f in Status: UNINITIALIZED for 2s [ 1084.562467] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.562733] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.562797] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.563064] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.563327] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.563561] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "port-43b7f58b-b27e-402c-8e8c-d9868e99c2df" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.633371] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1e5f0086-b1e3-4f00-8207-8306f153d0e4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.136755] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.136755] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.136755] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.136755] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.136755] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.136755] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 is going to be updated. [ 1085.175674] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.175674] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.176047] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.176047] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.176168] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.186058] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 in Status: IN_PROGRESS for 2s [ 1085.271527] env[65065]: INFO networking_nsxv3.common.synchronization [req-7e6c143e-6c2c-4ac7-a61f-5c29358b0c70 req-afcda931-42c7-4777-bc78-277950e68b90 service nova] Enqueued Resource ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 with Priority: HIGHEST for action security_group_rules [ 1085.271790] env[65065]: INFO networking_nsxv3.common.synchronization [req-7e6c143e-6c2c-4ac7-a61f-5c29358b0c70 req-afcda931-42c7-4777-bc78-277950e68b90 service nova] Enqueued Resource ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 with Priority: HIGHEST for action security_group_members [ 1085.272014] env[65065]: INFO networking_nsxv3.common.synchronization [req-7e6c143e-6c2c-4ac7-a61f-5c29358b0c70 req-afcda931-42c7-4777-bc78-277950e68b90 service nova] Enqueued Resource ID: 43b7f58b-b27e-402c-8e8c-d9868e99c2df with Priority: HIGHEST for action port [ 1085.272624] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 with Priority: HIGHEST for action security_group_rules [ 1085.272764] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 with Priority: HIGHEST for action security_group_members [ 1085.272875] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43b7f58b-b27e-402c-8e8c-d9868e99c2df with Priority: HIGHEST for action port [ 1085.273151] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1e5f0086-b1e3-4f00-8207-8306f153d0e4 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.273280] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.273344] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.273634] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.273718] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1e5f0086-b1e3-4f00-8207-8306f153d0e4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.274671] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e5f0086-b1e3-4f00-8207-8306f153d0e4 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.274765] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.274967] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-43b7f58b-b27e-402c-8e8c-d9868e99c2df taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.275079] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-43b7f58b-b27e-402c-8e8c-d9868e99c2df" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.275168] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-43b7f58b-b27e-402c-8e8c-d9868e99c2df" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.275502] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-43b7f58b-b27e-402c-8e8c-d9868e99c2df" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.275601] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('43b7f58b-b27e-402c-8e8c-d9868e99c2df',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.777789] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e5f0086-b1e3-4f00-8207-8306f153d0e4 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.779713] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.779713] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 43b7f58b-b27e-402c-8e8c-d9868e99c2df with status ACTIVE [ 1085.779713] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.779713] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.779713] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.779713] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.779713] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.779713] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.779713] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.779713] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.779713] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.779713] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.779713] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.780217] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.780217] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.780217] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.780217] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.780217] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 43b7f58b-b27e-402c-8e8c-d9868e99c2df is going to be updated. [ 1085.802798] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.803100] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.803100] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.803212] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.803335] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.803492] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-43b7f58b-b27e-402c-8e8c-d9868e99c2df" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.942748] env[65065]: INFO networking_nsxv3.common.synchronization [req-bf668f6d-0c8f-476d-ae5f-430a31e7a7cc req-6c48ed80-d1a4-44d3-b3da-5fcac0975683 tempest-AttachInterfacesTestJSON-1590270829 tempest-AttachInterfacesTestJSON-1590270829-project-member] Enqueued Resource ID: 54addcf5-1b30-4561-a83f-43a8cf610f46 with Priority: HIGHEST for action security_group_members [ 1085.943475] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54addcf5-1b30-4561-a83f-43a8cf610f46 with Priority: HIGHEST for action security_group_members [ 1085.943843] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-54addcf5-1b30-4561-a83f-43a8cf610f46 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.943967] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54addcf5-1b30-4561-a83f-43a8cf610f46" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.944088] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54addcf5-1b30-4561-a83f-43a8cf610f46" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.944339] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54addcf5-1b30-4561-a83f-43a8cf610f46" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.944575] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.944650] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.944650] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.944834] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.944942] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.945126] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('54addcf5-1b30-4561-a83f-43a8cf610f46',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.246371] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock network-688 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.246660] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "network-688" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.246747] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "network-688" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.246998] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "network-688" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.247318] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.247521] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.247643] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.247856] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.247999] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.248246] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1086.248362] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1086.248471] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1086.248580] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1086.248689] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1086.248929] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1086.249045] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1086.267790] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1086.268009] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1086.268168] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1086.268342] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "network-688" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.268657] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock port-d14b1bc0-3c63-4d76-a754-bc36abe5e058 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.268825] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "port-d14b1bc0-3c63-4d76-a754-bc36abe5e058" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.268941] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "port-d14b1bc0-3c63-4d76-a754-bc36abe5e058" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.269303] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "port-d14b1bc0-3c63-4d76-a754-bc36abe5e058" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.269444] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d14b1bc0-3c63-4d76-a754-bc36abe5e058',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.447482] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('54addcf5-1b30-4561-a83f-43a8cf610f46',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.557780] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8356bfa0-0d42-40e4-bec9-fd902715779f in Status: SUCCESS [ 1086.557780] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8356bfa0-0d42-40e4-bec9-fd902715779f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.557780] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8356bfa0-0d42-40e4-bec9-fd902715779f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.557780] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8356bfa0-0d42-40e4-bec9-fd902715779f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.557780] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.557780] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.557780] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.557780] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.557780] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.557780] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8356bfa0-0d42-40e4-bec9-fd902715779f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.557780] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8356bfa0-0d42-40e4-bec9-fd902715779f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.772146] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.772445] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.772645] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.772984] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.773192] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.773398] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Segment Port d14b1bc0-3c63-4d76-a754-bc36abe5e058 not found, creating... [ 1086.773730] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.773938] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.774117] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.774367] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.774511] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.774805] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.774963] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.775095] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.775304] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.775450] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.775589] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Resource: SegmentPort with ID: d14b1bc0-3c63-4d76-a754-bc36abe5e058 is going to be created. [ 1086.797868] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.798099] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.798220] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.798520] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.798757] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.799017] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "port-d14b1bc0-3c63-4d76-a754-bc36abe5e058" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.950902] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('54addcf5-1b30-4561-a83f-43a8cf610f46',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.060608] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8356bfa0-0d42-40e4-bec9-fd902715779f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.198230] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 in Status: SUCCESS [ 1087.198445] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.199059] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.199335] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.199542] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.199686] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.199756] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.199913] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.199995] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.200125] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e5f0086-b1e3-4f00-8207-8306f153d0e4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.453903] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.454270] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.454270] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.454348] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.454482] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.454550] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54addcf5-1b30-4561-a83f-43a8cf610f46 is going to be updated. [ 1087.485986] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.486171] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.486219] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.486415] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.486560] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.497625] env[65065]: INFO networking_nsxv3.common.synchronization [req-bf668f6d-0c8f-476d-ae5f-430a31e7a7cc req-e0299566-5479-4a31-8994-ce4d30b1ddac service nova] Enqueued Resource ID: 54addcf5-1b30-4561-a83f-43a8cf610f46 with Priority: HIGHEST for action security_group_rules [ 1087.497841] env[65065]: INFO networking_nsxv3.common.synchronization [req-bf668f6d-0c8f-476d-ae5f-430a31e7a7cc req-e0299566-5479-4a31-8994-ce4d30b1ddac service nova] Enqueued Resource ID: 54addcf5-1b30-4561-a83f-43a8cf610f46 with Priority: HIGHEST for action security_group_members [ 1087.497981] env[65065]: INFO networking_nsxv3.common.synchronization [req-bf668f6d-0c8f-476d-ae5f-430a31e7a7cc req-e0299566-5479-4a31-8994-ce4d30b1ddac service nova] Enqueued Resource ID: d14b1bc0-3c63-4d76-a754-bc36abe5e058 with Priority: HIGHEST for action port [ 1087.498848] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54addcf5-1b30-4561-a83f-43a8cf610f46 in Status: IN_PROGRESS for 2s [ 1087.499354] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54addcf5-1b30-4561-a83f-43a8cf610f46 with Priority: HIGHEST for action security_group_rules [ 1087.499492] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54addcf5-1b30-4561-a83f-43a8cf610f46 with Priority: HIGHEST for action security_group_members [ 1087.499622] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d14b1bc0-3c63-4d76-a754-bc36abe5e058 with Priority: HIGHEST for action port [ 1087.499862] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-54addcf5-1b30-4561-a83f-43a8cf610f46 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.499981] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-54addcf5-1b30-4561-a83f-43a8cf610f46" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.500059] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-54addcf5-1b30-4561-a83f-43a8cf610f46" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.500256] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-54addcf5-1b30-4561-a83f-43a8cf610f46" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.500338] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('54addcf5-1b30-4561-a83f-43a8cf610f46',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.501752] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-54addcf5-1b30-4561-a83f-43a8cf610f46 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.501752] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54addcf5-1b30-4561-a83f-43a8cf610f46" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.501752] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-d14b1bc0-3c63-4d76-a754-bc36abe5e058 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.501752] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d14b1bc0-3c63-4d76-a754-bc36abe5e058" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.501752] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d14b1bc0-3c63-4d76-a754-bc36abe5e058" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.501993] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d14b1bc0-3c63-4d76-a754-bc36abe5e058" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.501993] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d14b1bc0-3c63-4d76-a754-bc36abe5e058',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.562884] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8356bfa0-0d42-40e4-bec9-fd902715779f: rpc.has_security_group_logging(os_id): False [ 1087.595673] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.595814] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.595885] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.596138] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.596232] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.596486] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.596598] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.596662] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.596815] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.596902] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.596988] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8356bfa0-0d42-40e4-bec9-fd902715779f is going to be created. [ 1087.661637] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.661637] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.661637] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.661637] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.661833] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.674063] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8356bfa0-0d42-40e4-bec9-fd902715779f in Status: IN_PROGRESS for 2s [ 1087.702527] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1e5f0086-b1e3-4f00-8207-8306f153d0e4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.003224] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-54addcf5-1b30-4561-a83f-43a8cf610f46 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.003355] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54addcf5-1b30-4561-a83f-43a8cf610f46" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.003657] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d14b1bc0-3c63-4d76-a754-bc36abe5e058 with status ACTIVE [ 1088.003847] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.003955] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.004031] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.004246] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.004331] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.004590] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.004686] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.004751] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.004938] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.005048] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.005240] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.005333] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.005392] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.005529] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.005601] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.005683] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d14b1bc0-3c63-4d76-a754-bc36abe5e058 is going to be updated. [ 1088.033256] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.033499] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.033627] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.033801] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.033963] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.034154] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d14b1bc0-3c63-4d76-a754-bc36abe5e058" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.206512] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1e5f0086-b1e3-4f00-8207-8306f153d0e4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.220518] env[65065]: INFO networking_nsxv3.common.synchronization [req-e3f3d75e-ce53-4b86-8d36-5c6fcd34b680 req-3bcb32cb-6c13-4882-a7b4-f5275a332c69 tempest-ServerActionsTestOtherB-1640131964 tempest-ServerActionsTestOtherB-1640131964-project-member] Enqueued Resource ID: b95b4f27-41f6-4a01-a1aa-aa16348ad807 with Priority: HIGHEST for action security_group_members [ 1088.220609] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b95b4f27-41f6-4a01-a1aa-aa16348ad807 with Priority: HIGHEST for action security_group_members [ 1088.220953] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-b95b4f27-41f6-4a01-a1aa-aa16348ad807 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.221017] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b95b4f27-41f6-4a01-a1aa-aa16348ad807" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.221257] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b95b4f27-41f6-4a01-a1aa-aa16348ad807" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.221411] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b95b4f27-41f6-4a01-a1aa-aa16348ad807" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.221497] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.221597] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.221697] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.221855] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.221912] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.222019] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b95b4f27-41f6-4a01-a1aa-aa16348ad807',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.602503] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock network-8 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.602893] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "network-8" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.603022] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "network-8" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.603488] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "network-8" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.604439] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.604671] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.604831] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.605127] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.605285] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.605505] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1088.605621] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1088.605731] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1088.605840] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1088.605948] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1088.606064] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1088.606198] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1088.626971] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1088.627211] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1088.627387] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1088.627613] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "network-8" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.628015] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock port-de102b29-6098-4434-b840-813059216126 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.628233] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "port-de102b29-6098-4434-b840-813059216126" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.628407] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "port-de102b29-6098-4434-b840-813059216126" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.628786] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "port-de102b29-6098-4434-b840-813059216126" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.629039] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('de102b29-6098-4434-b840-813059216126',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.708600] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.708818] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.708884] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.709176] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.709331] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.709448] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 is going to be updated. [ 1088.724084] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.724271] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.724315] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.724776] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.724776] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.724873] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.724873] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.724986] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.725097] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.725217] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.725259] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b95b4f27-41f6-4a01-a1aa-aa16348ad807 is going to be updated. [ 1088.750015] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.750229] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.750309] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.750486] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.750631] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.752475] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.752622] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.752679] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.752817] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.752939] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.766346] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b95b4f27-41f6-4a01-a1aa-aa16348ad807 in Status: IN_PROGRESS for 2s [ 1088.767495] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 in Status: IN_PROGRESS for 2s [ 1089.131462] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.131795] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.131953] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.132351] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.132518] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.132710] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Segment Port de102b29-6098-4434-b840-813059216126 not found, creating... [ 1089.133032] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.133222] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.133341] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.133657] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.133782] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.134069] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.134228] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.134341] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.134550] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.134680] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.134819] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Resource: SegmentPort with ID: de102b29-6098-4434-b840-813059216126 is going to be created. [ 1089.158635] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.158971] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.158971] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.159303] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.159562] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.159890] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "port-de102b29-6098-4434-b840-813059216126" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.509026] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54addcf5-1b30-4561-a83f-43a8cf610f46 in Status: SUCCESS [ 1089.509273] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54addcf5-1b30-4561-a83f-43a8cf610f46" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.509566] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54addcf5-1b30-4561-a83f-43a8cf610f46" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.509898] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54addcf5-1b30-4561-a83f-43a8cf610f46" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.510136] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.510348] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.510425] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.510611] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.510696] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.510797] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('54addcf5-1b30-4561-a83f-43a8cf610f46',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.689720] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8356bfa0-0d42-40e4-bec9-fd902715779f in Status: SUCCESS [ 1089.689997] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8356bfa0-0d42-40e4-bec9-fd902715779f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.891650] env[65065]: INFO networking_nsxv3.common.synchronization [req-e3f3d75e-ce53-4b86-8d36-5c6fcd34b680 req-e556b2ef-6a90-4901-86cd-a913f50e5f17 service nova] Enqueued Resource ID: b95b4f27-41f6-4a01-a1aa-aa16348ad807 with Priority: HIGHEST for action security_group_rules [ 1089.891650] env[65065]: INFO networking_nsxv3.common.synchronization [req-e3f3d75e-ce53-4b86-8d36-5c6fcd34b680 req-e556b2ef-6a90-4901-86cd-a913f50e5f17 service nova] Enqueued Resource ID: b95b4f27-41f6-4a01-a1aa-aa16348ad807 with Priority: HIGHEST for action security_group_members [ 1089.891650] env[65065]: INFO networking_nsxv3.common.synchronization [req-e3f3d75e-ce53-4b86-8d36-5c6fcd34b680 req-e556b2ef-6a90-4901-86cd-a913f50e5f17 service nova] Enqueued Resource ID: de102b29-6098-4434-b840-813059216126 with Priority: HIGHEST for action port [ 1089.891874] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b95b4f27-41f6-4a01-a1aa-aa16348ad807 with Priority: HIGHEST for action security_group_rules [ 1089.892026] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b95b4f27-41f6-4a01-a1aa-aa16348ad807 with Priority: HIGHEST for action security_group_members [ 1089.892326] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de102b29-6098-4434-b840-813059216126 with Priority: HIGHEST for action port [ 1089.892586] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b95b4f27-41f6-4a01-a1aa-aa16348ad807 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.892697] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b95b4f27-41f6-4a01-a1aa-aa16348ad807" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.892807] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b95b4f27-41f6-4a01-a1aa-aa16348ad807" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.892972] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b95b4f27-41f6-4a01-a1aa-aa16348ad807" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.893062] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b95b4f27-41f6-4a01-a1aa-aa16348ad807',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.894987] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-b95b4f27-41f6-4a01-a1aa-aa16348ad807 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.895147] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b95b4f27-41f6-4a01-a1aa-aa16348ad807" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.897905] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-de102b29-6098-4434-b840-813059216126 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.897905] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-de102b29-6098-4434-b840-813059216126" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.897905] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-de102b29-6098-4434-b840-813059216126" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.897905] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-de102b29-6098-4434-b840-813059216126" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.897905] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('de102b29-6098-4434-b840-813059216126',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.013452] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('54addcf5-1b30-4561-a83f-43a8cf610f46',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.395692] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-b95b4f27-41f6-4a01-a1aa-aa16348ad807 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.395860] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b95b4f27-41f6-4a01-a1aa-aa16348ad807" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.398199] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port de102b29-6098-4434-b840-813059216126 with status ACTIVE [ 1090.398358] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.398476] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.398535] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.398744] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.398835] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.398999] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.399107] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.399172] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.399319] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.399396] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.399570] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.399662] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.399722] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.399893] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.399929] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.400011] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: de102b29-6098-4434-b840-813059216126 is going to be updated. [ 1090.419745] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.419943] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.419943] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.420135] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.420269] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.420430] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-de102b29-6098-4434-b840-813059216126" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.516188] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('54addcf5-1b30-4561-a83f-43a8cf610f46',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.778256] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b95b4f27-41f6-4a01-a1aa-aa16348ad807 in Status: SUCCESS [ 1090.778586] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b95b4f27-41f6-4a01-a1aa-aa16348ad807 deletion is rescheduled due to dependency. [ 1090.778586] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b95b4f27-41f6-4a01-a1aa-aa16348ad807" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.778698] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b95b4f27-41f6-4a01-a1aa-aa16348ad807" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.778915] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b95b4f27-41f6-4a01-a1aa-aa16348ad807" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.779113] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.779234] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.779298] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.779447] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.779527] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.779621] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b95b4f27-41f6-4a01-a1aa-aa16348ad807',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.781518] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 in Status: SUCCESS [ 1090.781747] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.781897] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.782243] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.782454] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.782570] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.782636] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.782784] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.782861] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.782964] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.783046] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1e5f0086-b1e3-4f00-8207-8306f153d0e4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.019134] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.019134] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.019134] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.019134] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.019562] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.019562] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54addcf5-1b30-4561-a83f-43a8cf610f46 is going to be updated. [ 1091.048704] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.048840] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.048894] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.049120] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.049278] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.057962] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54addcf5-1b30-4561-a83f-43a8cf610f46 in Status: IN_PROGRESS for 2s [ 1091.284918] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e5f0086-b1e3-4f00-8207-8306f153d0e4 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.285098] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.285171] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.285459] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.285688] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.285799] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.285837] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.286620] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.286620] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.286620] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.286620] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e5f0086-b1e3-4f00-8207-8306f153d0e4 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.286620] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.286620] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.286852] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.286880] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.286960] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.287023] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.287187] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.287271] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.287319] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.287405] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1e5f0086-b1e3-4f00-8207-8306f153d0e4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.289658] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b95b4f27-41f6-4a01-a1aa-aa16348ad807',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.790598] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1e5f0086-b1e3-4f00-8207-8306f153d0e4: rpc.has_security_group_logging(os_id): False [ 1091.791813] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b95b4f27-41f6-4a01-a1aa-aa16348ad807',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.813463] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.813684] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.813772] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.814088] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.814236] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.814780] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.814780] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.814780] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.815110] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.815110] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.815185] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.815240] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.815295] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.815456] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.815535] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.815729] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.815822] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.815887] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.816069] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.816106] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.816192] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 is going to be updated. [ 1091.922875] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.923152] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.923152] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.923331] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.923471] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.945673] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 in Status: IN_PROGRESS for 2s [ 1092.294896] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.295073] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.295182] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.295394] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.295491] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.295596] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b95b4f27-41f6-4a01-a1aa-aa16348ad807 is going to be updated. [ 1092.330445] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.330689] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.330689] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.334022] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.334022] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.340245] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b95b4f27-41f6-4a01-a1aa-aa16348ad807 in Status: IN_PROGRESS for 2s [ 1093.073954] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54addcf5-1b30-4561-a83f-43a8cf610f46 in Status: SUCCESS [ 1093.074233] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54addcf5-1b30-4561-a83f-43a8cf610f46" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.074351] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54addcf5-1b30-4561-a83f-43a8cf610f46" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.074568] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54addcf5-1b30-4561-a83f-43a8cf610f46" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.074783] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.074899] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.074964] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.075131] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.075212] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.075298] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54addcf5-1b30-4561-a83f-43a8cf610f46" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.075431] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('54addcf5-1b30-4561-a83f-43a8cf610f46',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.577322] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('54addcf5-1b30-4561-a83f-43a8cf610f46',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.965401] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 in Status: SUCCESS [ 1093.965811] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.079492] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 54addcf5-1b30-4561-a83f-43a8cf610f46: rpc.has_security_group_logging(os_id): False [ 1094.114571] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.114571] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.114571] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.114815] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.114815] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.114995] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.115119] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.115179] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.115345] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.115412] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.115506] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 54addcf5-1b30-4561-a83f-43a8cf610f46 is going to be updated. [ 1094.190880] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.191284] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.191481] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.192041] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.192041] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.205434] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 54addcf5-1b30-4561-a83f-43a8cf610f46 in Status: IN_PROGRESS for 2s [ 1094.350247] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b95b4f27-41f6-4a01-a1aa-aa16348ad807 in Status: SUCCESS [ 1094.350469] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b95b4f27-41f6-4a01-a1aa-aa16348ad807" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.350665] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b95b4f27-41f6-4a01-a1aa-aa16348ad807" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.350916] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b95b4f27-41f6-4a01-a1aa-aa16348ad807" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.351205] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.351413] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.351512] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.351724] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.351810] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.351905] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b95b4f27-41f6-4a01-a1aa-aa16348ad807" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.352036] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b95b4f27-41f6-4a01-a1aa-aa16348ad807',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.855029] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b95b4f27-41f6-4a01-a1aa-aa16348ad807',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.893669] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1094.893669] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1095.356430] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b95b4f27-41f6-4a01-a1aa-aa16348ad807: rpc.has_security_group_logging(os_id): False [ 1095.376306] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.376475] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.376519] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.376728] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.376817] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.377063] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.377164] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.377228] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.377405] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.377514] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.377548] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b95b4f27-41f6-4a01-a1aa-aa16348ad807 is going to be updated. [ 1095.433335] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.433590] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.433590] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.433776] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.433904] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.450021] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b95b4f27-41f6-4a01-a1aa-aa16348ad807 in Status: IN_PROGRESS for 2s [ 1096.218990] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 54addcf5-1b30-4561-a83f-43a8cf610f46 in Status: SUCCESS [ 1096.219327] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-54addcf5-1b30-4561-a83f-43a8cf610f46" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.435956] env[65065]: INFO networking_nsxv3.common.synchronization [req-27ba8114-d641-4328-93f0-fa4b656759be req-d92a15e4-0a0d-4b00-905e-a88e4fa46972 tempest-ServersTestJSON-1126920631 tempest-ServersTestJSON-1126920631-project-member] Enqueued Resource ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 with Priority: HIGHEST for action security_group_members [ 1096.435956] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 with Priority: HIGHEST for action security_group_members [ 1096.436401] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e5f0086-b1e3-4f00-8207-8306f153d0e4 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.436676] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.436853] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.437173] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.437445] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.437738] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.437904] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.438184] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.438396] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.438601] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e5f0086-b1e3-4f00-8207-8306f153d0e4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.940906] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1e5f0086-b1e3-4f00-8207-8306f153d0e4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.443843] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1e5f0086-b1e3-4f00-8207-8306f153d0e4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.467337] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b95b4f27-41f6-4a01-a1aa-aa16348ad807 in Status: SUCCESS [ 1097.467337] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b95b4f27-41f6-4a01-a1aa-aa16348ad807" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.475144] env[65065]: INFO networking_nsxv3.common.synchronization [None req-51489b82-9efb-4bf5-8944-a625540bcedf tempest-AttachInterfacesTestJSON-1590270829 tempest-AttachInterfacesTestJSON-1590270829-project-member] Enqueued Resource ID: e2e5973c-5504-4cd5-9f92-77ba0193d841 with Priority: HIGHEST for action security_group_members [ 1097.475403] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2e5973c-5504-4cd5-9f92-77ba0193d841 with Priority: HIGHEST for action security_group_members [ 1097.475965] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2e5973c-5504-4cd5-9f92-77ba0193d841 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.475965] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.476101] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.476522] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.476522] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.476522] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.476522] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.476790] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.476890] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.477077] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2e5973c-5504-4cd5-9f92-77ba0193d841',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.946503] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.946503] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.946503] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.946503] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.946795] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.946795] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 is going to be updated. [ 1097.978981] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.979170] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.979266] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.979711] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.979811] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.980042] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.980158] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.980224] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.980402] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.980487] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.980577] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2e5973c-5504-4cd5-9f92-77ba0193d841 is going to be updated. [ 1097.984807] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.984987] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.985034] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.985227] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.985395] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.996485] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 in Status: IN_PROGRESS for 2s [ 1098.017956] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.018125] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.018197] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.018460] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.018738] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.028060] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2e5973c-5504-4cd5-9f92-77ba0193d841 in Status: IN_PROGRESS for 2s [ 1100.007452] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 in Status: SUCCESS [ 1100.008023] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.038026] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2e5973c-5504-4cd5-9f92-77ba0193d841 in Status: SUCCESS [ 1100.038379] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2e5973c-5504-4cd5-9f92-77ba0193d841 deletion is rescheduled due to dependency. [ 1100.038494] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.476324] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1102.476747] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1102.970720] env[65065]: INFO networking_nsxv3.common.synchronization [req-a12449db-b31a-4e22-8477-b3eb5d4e4b8f req-38b5160b-dba1-4a9d-9fde-f538ce5d54c2 tempest-DeleteServersTestJSON-1316666736 tempest-DeleteServersTestJSON-1316666736-project-member] Enqueued Resource ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 with Priority: HIGHEST for action security_group_members [ 1102.971296] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 with Priority: HIGHEST for action security_group_members [ 1102.971640] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d0941d4-57d8-45e9-9f2f-95128b8136e5 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.973588] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.973945] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.973945] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.974492] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.974492] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.974492] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.974492] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.974492] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.974492] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d0941d4-57d8-45e9-9f2f-95128b8136e5',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.477396] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.477807] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.477807] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.477874] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.478018] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.478128] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.478223] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.478278] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.478431] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.478522] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.478614] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 is going to be updated. [ 1103.507835] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.507835] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.507835] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.508115] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.508115] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.517018] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 in Status: IN_PROGRESS for 2s [ 1104.128206] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock network-470 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.128400] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "network-470" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.128526] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "network-470" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.128790] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "network-470" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.129046] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.129201] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.129322] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.129562] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.129704] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.129910] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1104.130031] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1104.130140] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1104.130248] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1104.130354] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1104.130457] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1104.130586] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1104.171474] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1104.171809] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Cache value generated in 0.041 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1104.172093] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1104.172402] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "network-470" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.172927] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock port-b76f7643-3590-4fb0-9845-ac21557501c9 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.173251] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "port-b76f7643-3590-4fb0-9845-ac21557501c9" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.173426] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "port-b76f7643-3590-4fb0-9845-ac21557501c9" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.173772] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "port-b76f7643-3590-4fb0-9845-ac21557501c9" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.174138] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b76f7643-3590-4fb0-9845-ac21557501c9',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.676811] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.676811] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.677376] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.677376] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.677452] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.677812] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.678021] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.678157] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.678380] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.678514] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.678892] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.679017] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.679102] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.679298] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.679437] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.679590] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Resource: SegmentPort with ID: b76f7643-3590-4fb0-9845-ac21557501c9 is going to be updated. [ 1104.703207] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.703445] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.703542] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.703821] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.704032] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.704260] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "port-b76f7643-3590-4fb0-9845-ac21557501c9" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.395287] env[65065]: INFO networking_nsxv3.common.synchronization [req-2fb0afcb-76e9-460a-9788-cff7c6fa5a82 req-56a4774f-c2cf-43ea-823b-3438646e2086 service nova] Enqueued Resource ID: d0abfe3e-a5d3-4a8d-bdc5-c03daff4976f with Priority: HIGHEST for action security_group_rules [ 1105.395470] env[65065]: INFO networking_nsxv3.common.synchronization [req-2fb0afcb-76e9-460a-9788-cff7c6fa5a82 req-56a4774f-c2cf-43ea-823b-3438646e2086 service nova] Enqueued Resource ID: d0abfe3e-a5d3-4a8d-bdc5-c03daff4976f with Priority: HIGHEST for action security_group_members [ 1105.395607] env[65065]: INFO networking_nsxv3.common.synchronization [req-2fb0afcb-76e9-460a-9788-cff7c6fa5a82 req-56a4774f-c2cf-43ea-823b-3438646e2086 service nova] Enqueued Resource ID: b76f7643-3590-4fb0-9845-ac21557501c9 with Priority: HIGHEST for action port [ 1105.396665] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0abfe3e-a5d3-4a8d-bdc5-c03daff4976f with Priority: HIGHEST for action security_group_rules [ 1105.396665] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0abfe3e-a5d3-4a8d-bdc5-c03daff4976f with Priority: HIGHEST for action security_group_members [ 1105.396665] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b76f7643-3590-4fb0-9845-ac21557501c9 with Priority: HIGHEST for action port [ 1105.396665] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d0abfe3e-a5d3-4a8d-bdc5-c03daff4976f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.396984] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d0abfe3e-a5d3-4a8d-bdc5-c03daff4976f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.396984] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d0abfe3e-a5d3-4a8d-bdc5-c03daff4976f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.396984] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d0abfe3e-a5d3-4a8d-bdc5-c03daff4976f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.397089] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d0abfe3e-a5d3-4a8d-bdc5-c03daff4976f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.397882] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0abfe3e-a5d3-4a8d-bdc5-c03daff4976f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.398356] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0abfe3e-a5d3-4a8d-bdc5-c03daff4976f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.398924] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0abfe3e-a5d3-4a8d-bdc5-c03daff4976f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.398924] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0abfe3e-a5d3-4a8d-bdc5-c03daff4976f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.398924] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.399121] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.399121] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.399190] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.399265] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.399378] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d0abfe3e-a5d3-4a8d-bdc5-c03daff4976f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.401096] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-b76f7643-3590-4fb0-9845-ac21557501c9 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.401493] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b76f7643-3590-4fb0-9845-ac21557501c9" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.402629] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b76f7643-3590-4fb0-9845-ac21557501c9" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.402629] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b76f7643-3590-4fb0-9845-ac21557501c9" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.402629] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b76f7643-3590-4fb0-9845-ac21557501c9',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.527770] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 in Status: SUCCESS [ 1105.527974] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 deletion is rescheduled due to dependency. [ 1105.528079] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.901579] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d0abfe3e-a5d3-4a8d-bdc5-c03daff4976f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.903767] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0abfe3e-a5d3-4a8d-bdc5-c03daff4976f taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.903767] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0abfe3e-a5d3-4a8d-bdc5-c03daff4976f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.903767] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b76f7643-3590-4fb0-9845-ac21557501c9 with status ACTIVE [ 1105.903767] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.903991] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.903991] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.904165] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.904251] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.904418] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.904515] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.904576] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.904726] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.904801] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.904973] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.905076] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.905136] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.905271] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.905343] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.905436] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b76f7643-3590-4fb0-9845-ac21557501c9 is going to be updated. [ 1105.927325] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.927521] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.927570] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.927838] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.927989] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.928185] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b76f7643-3590-4fb0-9845-ac21557501c9" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.403894] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d0abfe3e-a5d3-4a8d-bdc5-c03daff4976f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.858793] env[65065]: INFO networking_nsxv3.common.synchronization [req-5ab700fe-6efd-4e27-8047-b40068aedada req-27c90ce5-582e-4032-be10-b7f239785b50 tempest-ServersTestJSON-1126920631 tempest-ServersTestJSON-1126920631-project-member] Enqueued Resource ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 with Priority: HIGHEST for action security_group_members [ 1106.859569] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 with Priority: HIGHEST for action security_group_members [ 1106.860060] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e5f0086-b1e3-4f00-8207-8306f153d0e4 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.860185] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.860284] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.860577] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.860794] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.861448] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.861448] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.861448] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.861448] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.861631] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e5f0086-b1e3-4f00-8207-8306f153d0e4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.906763] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.907112] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.907112] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.907217] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.907533] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.907533] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0abfe3e-a5d3-4a8d-bdc5-c03daff4976f is going to be updated. [ 1106.963916] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.964139] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.964186] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.964414] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.964591] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.975021] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0abfe3e-a5d3-4a8d-bdc5-c03daff4976f in Status: IN_PROGRESS for 2s [ 1107.169275] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock network-381 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.169546] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "network-381" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.169680] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "network-381" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.169945] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "network-381" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.170216] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.170370] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.170486] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.170700] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.170841] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.171055] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1107.171164] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1107.171273] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1107.171378] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1107.171536] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1107.171652] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1107.171781] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1107.189164] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1107.189332] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1107.189504] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1107.189674] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "network-381" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.189979] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock port-af5711f4-7fc7-4f89-a026-9648f9c43a40 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.190171] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "port-af5711f4-7fc7-4f89-a026-9648f9c43a40" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.190290] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "port-af5711f4-7fc7-4f89-a026-9648f9c43a40" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.190607] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "port-af5711f4-7fc7-4f89-a026-9648f9c43a40" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.190746] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('af5711f4-7fc7-4f89-a026-9648f9c43a40',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.363928] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1e5f0086-b1e3-4f00-8207-8306f153d0e4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.693654] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.693842] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.693962] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.694281] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.694437] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.694598] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Segment Port af5711f4-7fc7-4f89-a026-9648f9c43a40 not found, creating... [ 1107.694859] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.695064] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.695189] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.695410] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.695544] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.695846] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.696098] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.696339] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.696675] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.696907] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.697208] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Resource: SegmentPort with ID: af5711f4-7fc7-4f89-a026-9648f9c43a40 is going to be created. [ 1107.727689] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.727904] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.728056] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.728310] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.728533] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.728762] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "port-af5711f4-7fc7-4f89-a026-9648f9c43a40" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.866722] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1e5f0086-b1e3-4f00-8207-8306f153d0e4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.369614] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.369947] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.369947] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.370201] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.370201] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.370303] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 is going to be updated. [ 1108.405095] env[65065]: INFO networking_nsxv3.common.synchronization [req-5ab700fe-6efd-4e27-8047-b40068aedada req-ea68d8cc-c1b5-4d0e-acd1-f81bdba04a56 service nova] Enqueued Resource ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 with Priority: HIGHEST for action security_group_rules [ 1108.405294] env[65065]: INFO networking_nsxv3.common.synchronization [req-5ab700fe-6efd-4e27-8047-b40068aedada req-ea68d8cc-c1b5-4d0e-acd1-f81bdba04a56 service nova] Enqueued Resource ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 with Priority: HIGHEST for action security_group_members [ 1108.405429] env[65065]: INFO networking_nsxv3.common.synchronization [req-5ab700fe-6efd-4e27-8047-b40068aedada req-ea68d8cc-c1b5-4d0e-acd1-f81bdba04a56 service nova] Enqueued Resource ID: af5711f4-7fc7-4f89-a026-9648f9c43a40 with Priority: HIGHEST for action port [ 1108.405954] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 with Priority: HIGHEST for action security_group_rules [ 1108.406452] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 with Priority: HIGHEST for action security_group_members [ 1108.406568] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af5711f4-7fc7-4f89-a026-9648f9c43a40 with Priority: HIGHEST for action port [ 1108.406920] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1e5f0086-b1e3-4f00-8207-8306f153d0e4 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.407098] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.407098] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.407261] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.407342] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1e5f0086-b1e3-4f00-8207-8306f153d0e4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.408318] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e5f0086-b1e3-4f00-8207-8306f153d0e4 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.408696] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.408936] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-af5711f4-7fc7-4f89-a026-9648f9c43a40 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.409055] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-af5711f4-7fc7-4f89-a026-9648f9c43a40" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.409123] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-af5711f4-7fc7-4f89-a026-9648f9c43a40" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.409308] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-af5711f4-7fc7-4f89-a026-9648f9c43a40" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.409389] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('af5711f4-7fc7-4f89-a026-9648f9c43a40',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.411065] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.411213] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.411246] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.412013] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.412013] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.423298] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 in Status: IN_PROGRESS for 2s [ 1108.913736] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e5f0086-b1e3-4f00-8207-8306f153d0e4 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.913957] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.914022] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port af5711f4-7fc7-4f89-a026-9648f9c43a40 with status ACTIVE [ 1108.914200] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.914330] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.914399] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.914724] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.914804] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.914986] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.915099] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.915161] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.915324] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.915405] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.915584] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.915677] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.915735] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.915874] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.915946] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.916042] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: af5711f4-7fc7-4f89-a026-9648f9c43a40 is going to be updated. [ 1108.937165] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.937332] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.937373] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.937564] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.937729] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.937935] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-af5711f4-7fc7-4f89-a026-9648f9c43a40" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.984601] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0abfe3e-a5d3-4a8d-bdc5-c03daff4976f in Status: SUCCESS [ 1108.984840] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0abfe3e-a5d3-4a8d-bdc5-c03daff4976f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.985076] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0abfe3e-a5d3-4a8d-bdc5-c03daff4976f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.985299] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0abfe3e-a5d3-4a8d-bdc5-c03daff4976f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.985494] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.985604] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.985670] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.985814] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.985899] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.985980] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0abfe3e-a5d3-4a8d-bdc5-c03daff4976f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.986080] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d0abfe3e-a5d3-4a8d-bdc5-c03daff4976f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.488809] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d0abfe3e-a5d3-4a8d-bdc5-c03daff4976f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.701307] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock network-688 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.701540] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "network-688" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.701691] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "network-688" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.701953] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "network-688" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.702322] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.702500] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.702693] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.702927] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.703143] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.703433] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1109.704170] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1109.704305] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1109.704422] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1109.704572] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1109.704716] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1109.704860] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1109.726142] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1109.726325] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1109.726484] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1109.726706] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "network-688" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.727056] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock port-5d990423-d817-4301-8687-6e6ed9fec4a1 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.727284] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "port-5d990423-d817-4301-8687-6e6ed9fec4a1" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.727416] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "port-5d990423-d817-4301-8687-6e6ed9fec4a1" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.727763] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "port-5d990423-d817-4301-8687-6e6ed9fec4a1" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.727903] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5d990423-d817-4301-8687-6e6ed9fec4a1',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.991842] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d0abfe3e-a5d3-4a8d-bdc5-c03daff4976f: rpc.has_security_group_logging(os_id): False [ 1110.013075] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.013244] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.013294] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.013555] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.037888] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.037888] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.038170] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.038170] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.039075] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.039075] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.039075] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d0abfe3e-a5d3-4a8d-bdc5-c03daff4976f is going to be updated. [ 1110.112392] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.112563] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.112617] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.112866] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.112943] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.129382] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d0abfe3e-a5d3-4a8d-bdc5-c03daff4976f in Status: IN_PROGRESS for 2s [ 1110.230312] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.230634] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.230861] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.231195] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.231357] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.231629] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Segment Port 5d990423-d817-4301-8687-6e6ed9fec4a1 not found, creating... [ 1110.231977] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.232195] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.232371] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.232800] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.232984] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.233364] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.233578] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.233719] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.234073] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.234288] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.234511] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Resource: SegmentPort with ID: 5d990423-d817-4301-8687-6e6ed9fec4a1 is going to be created. [ 1110.257794] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.258047] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.258218] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.258582] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.258843] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.259091] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "port-5d990423-d817-4301-8687-6e6ed9fec4a1" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.434032] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 in Status: SUCCESS [ 1110.434276] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.434524] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.434774] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.434967] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.435102] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.435167] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.435333] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.435416] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.435513] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e5f0086-b1e3-4f00-8207-8306f153d0e4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.938568] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1e5f0086-b1e3-4f00-8207-8306f153d0e4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.983726] env[65065]: INFO networking_nsxv3.common.synchronization [req-436f80cc-3b00-48aa-9c28-f1a136a80f86 req-6f3d7edf-9225-49e1-928d-7fab049f5579 service nova] Enqueued Resource ID: e2e5973c-5504-4cd5-9f92-77ba0193d841 with Priority: HIGHEST for action security_group_rules [ 1110.987197] env[65065]: INFO networking_nsxv3.common.synchronization [req-436f80cc-3b00-48aa-9c28-f1a136a80f86 req-6f3d7edf-9225-49e1-928d-7fab049f5579 service nova] Enqueued Resource ID: e2e5973c-5504-4cd5-9f92-77ba0193d841 with Priority: HIGHEST for action security_group_members [ 1110.987197] env[65065]: INFO networking_nsxv3.common.synchronization [req-436f80cc-3b00-48aa-9c28-f1a136a80f86 req-6f3d7edf-9225-49e1-928d-7fab049f5579 service nova] Enqueued Resource ID: 5d990423-d817-4301-8687-6e6ed9fec4a1 with Priority: HIGHEST for action port [ 1110.987347] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2e5973c-5504-4cd5-9f92-77ba0193d841 with Priority: HIGHEST for action security_group_rules [ 1110.987440] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2e5973c-5504-4cd5-9f92-77ba0193d841 with Priority: HIGHEST for action security_group_members [ 1110.987539] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d990423-d817-4301-8687-6e6ed9fec4a1 with Priority: HIGHEST for action port [ 1110.987859] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e2e5973c-5504-4cd5-9f92-77ba0193d841 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.988022] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.988109] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.988756] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.988890] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e2e5973c-5504-4cd5-9f92-77ba0193d841',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.990028] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2e5973c-5504-4cd5-9f92-77ba0193d841 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.990092] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.990125] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.990298] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.990455] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.990552] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.990617] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.990755] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.990838] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.990927] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2e5973c-5504-4cd5-9f92-77ba0193d841',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.991729] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-5d990423-d817-4301-8687-6e6ed9fec4a1 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.991821] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5d990423-d817-4301-8687-6e6ed9fec4a1" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.992558] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5d990423-d817-4301-8687-6e6ed9fec4a1" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.992558] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5d990423-d817-4301-8687-6e6ed9fec4a1" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.992558] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5d990423-d817-4301-8687-6e6ed9fec4a1',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.440663] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1e5f0086-b1e3-4f00-8207-8306f153d0e4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.494835] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5d990423-d817-4301-8687-6e6ed9fec4a1 with status ACTIVE [ 1111.495078] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.495292] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.495292] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.495608] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.495669] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.495828] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.495933] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.496015] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.496162] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.496239] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.496448] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.496496] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.496558] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.496691] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.496766] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.496854] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5d990423-d817-4301-8687-6e6ed9fec4a1 is going to be updated. [ 1111.498142] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2e5973c-5504-4cd5-9f92-77ba0193d841 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.498266] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.498370] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e2e5973c-5504-4cd5-9f92-77ba0193d841',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.521461] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.521698] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.521776] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.521987] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.522137] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.522301] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5d990423-d817-4301-8687-6e6ed9fec4a1" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.943253] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.943253] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.943253] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.943639] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.943639] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.943639] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 is going to be updated. [ 1111.972927] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.973144] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.973190] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.973459] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.973602] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.985744] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 in Status: IN_PROGRESS for 2s [ 1112.000276] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e2e5973c-5504-4cd5-9f92-77ba0193d841',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.240613] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d0abfe3e-a5d3-4a8d-bdc5-c03daff4976f in Status: SUCCESS [ 1112.240613] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d0abfe3e-a5d3-4a8d-bdc5-c03daff4976f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.503060] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.503060] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.503060] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.503060] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.503060] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.503393] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2e5973c-5504-4cd5-9f92-77ba0193d841 is going to be updated. [ 1112.535751] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.535958] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.536096] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.536550] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.536954] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.546427] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2e5973c-5504-4cd5-9f92-77ba0193d841 in Status: IN_PROGRESS for 2s [ 1113.995224] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 in Status: SUCCESS [ 1113.995536] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.995536] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.995746] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.995939] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.996068] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.996134] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.996279] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.996356] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.996439] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.996532] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1e5f0086-b1e3-4f00-8207-8306f153d0e4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.498551] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e5f0086-b1e3-4f00-8207-8306f153d0e4 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.498790] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.498878] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.499313] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.499455] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.499685] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.499685] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.499814] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.499890] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.500011] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.500189] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e5f0086-b1e3-4f00-8207-8306f153d0e4 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.500302] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.500387] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.500550] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.500711] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.500823] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.500892] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.501343] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.501452] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.501606] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.501707] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1e5f0086-b1e3-4f00-8207-8306f153d0e4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.557954] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2e5973c-5504-4cd5-9f92-77ba0193d841 in Status: SUCCESS [ 1114.558329] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.558568] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.558876] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.559143] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.559272] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.559342] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.559514] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.559729] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.559729] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.559827] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e2e5973c-5504-4cd5-9f92-77ba0193d841',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.006116] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1e5f0086-b1e3-4f00-8207-8306f153d0e4: rpc.has_security_group_logging(os_id): False [ 1115.026556] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.026752] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.026752] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.026976] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.027073] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.027288] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.027385] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.027449] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.027676] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.027771] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.027951] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.028107] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.028107] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.028247] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.028318] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.028518] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.028610] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.028672] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.028807] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.028879] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.028965] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 is going to be updated. [ 1115.062703] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2e5973c-5504-4cd5-9f92-77ba0193d841 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.062930] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.062981] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.063208] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.063377] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.063484] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.063586] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.063681] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.063763] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.063898] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.064040] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2e5973c-5504-4cd5-9f92-77ba0193d841 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.064140] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.064200] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.064340] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.064475] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.064562] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.064623] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.064754] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.064829] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.064908] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.064994] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e2e5973c-5504-4cd5-9f92-77ba0193d841',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.107541] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.107736] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.107797] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.108375] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.108375] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.154304] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 in Status: IN_PROGRESS for 2s [ 1115.566948] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e2e5973c-5504-4cd5-9f92-77ba0193d841: rpc.has_security_group_logging(os_id): False [ 1115.588687] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.588911] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.588968] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.589206] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.589321] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.589506] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.589664] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.589711] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.589998] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.589998] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.590209] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.590359] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.590359] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.590506] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.590596] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.590855] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.591028] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.591028] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.591177] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.591346] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.591346] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e2e5973c-5504-4cd5-9f92-77ba0193d841 is going to be updated. [ 1115.662676] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.662874] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.662874] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.663157] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.663323] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.677533] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2e5973c-5504-4cd5-9f92-77ba0193d841 in Status: IN_PROGRESS for 2s [ 1115.988645] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1115.988829] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1117.182170] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 in Status: SUCCESS [ 1117.182548] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.691858] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2e5973c-5504-4cd5-9f92-77ba0193d841 in Status: SUCCESS [ 1117.692119] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.989649] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1120.989972] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1123.001579] env[65065]: INFO networking_nsxv3.common.synchronization [req-9389e751-69ad-43e4-9d72-2e9dff9bac30 req-8edffc56-952f-4638-ab4f-dfb11714ee57 tempest-ServersTestJSON-1126920631 tempest-ServersTestJSON-1126920631-project-member] Enqueued Resource ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 with Priority: HIGHEST for action security_group_members [ 1123.002237] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 with Priority: HIGHEST for action security_group_members [ 1123.002561] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e5f0086-b1e3-4f00-8207-8306f153d0e4 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.002683] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.002750] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.003222] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.003385] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.003518] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.003590] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.004260] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.004352] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.004457] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e5f0086-b1e3-4f00-8207-8306f153d0e4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.507176] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1e5f0086-b1e3-4f00-8207-8306f153d0e4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.009096] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1e5f0086-b1e3-4f00-8207-8306f153d0e4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.512433] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.512433] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.512433] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.512642] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.512642] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.512799] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 is going to be updated. [ 1124.553874] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.554111] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.554191] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.554572] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.554738] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.566217] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 in Status: IN_PROGRESS for 2s [ 1126.581247] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 in Status: SUCCESS [ 1126.581625] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.986417] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock network-688 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.986625] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "network-688" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.986748] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "network-688" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.987036] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "network-688" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.987296] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.987460] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.987577] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.987796] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.987939] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.988165] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1126.988279] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1126.988385] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1126.988491] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1126.988598] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1126.988700] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1126.988827] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1127.008204] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1127.008387] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1127.008524] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1127.008700] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "network-688" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.009040] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock port-5d990423-d817-4301-8687-6e6ed9fec4a1 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.009223] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "port-5d990423-d817-4301-8687-6e6ed9fec4a1" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.009373] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "port-5d990423-d817-4301-8687-6e6ed9fec4a1" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.009594] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "port-5d990423-d817-4301-8687-6e6ed9fec4a1" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.009751] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5d990423-d817-4301-8687-6e6ed9fec4a1',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.513648] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.513853] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.513975] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.514333] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.514476] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.514757] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.514913] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.515041] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.515258] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.515388] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.515660] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.515810] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.515922] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.516133] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.516261] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.516394] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Resource: SegmentPort with ID: 5d990423-d817-4301-8687-6e6ed9fec4a1 is going to be updated. [ 1127.539609] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.539928] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.540069] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.540340] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.540534] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.540754] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "port-5d990423-d817-4301-8687-6e6ed9fec4a1" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.003445] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1128.003788] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1128.244678] env[65065]: INFO networking_nsxv3.common.synchronization [req-b2b6492a-9451-4b8e-af7f-0204684c7a99 req-e7cf852b-02c7-44a3-98a3-7fadad7f7758 service nova] Enqueued Resource ID: e2e5973c-5504-4cd5-9f92-77ba0193d841 with Priority: HIGHEST for action security_group_rules [ 1128.244997] env[65065]: INFO networking_nsxv3.common.synchronization [req-b2b6492a-9451-4b8e-af7f-0204684c7a99 req-e7cf852b-02c7-44a3-98a3-7fadad7f7758 service nova] Enqueued Resource ID: e2e5973c-5504-4cd5-9f92-77ba0193d841 with Priority: HIGHEST for action security_group_members [ 1128.245390] env[65065]: INFO networking_nsxv3.common.synchronization [req-b2b6492a-9451-4b8e-af7f-0204684c7a99 req-e7cf852b-02c7-44a3-98a3-7fadad7f7758 service nova] Enqueued Resource ID: 5d990423-d817-4301-8687-6e6ed9fec4a1 with Priority: HIGHEST for action port [ 1128.246131] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2e5973c-5504-4cd5-9f92-77ba0193d841 with Priority: HIGHEST for action security_group_rules [ 1128.246362] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2e5973c-5504-4cd5-9f92-77ba0193d841 with Priority: HIGHEST for action security_group_members [ 1128.246511] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d990423-d817-4301-8687-6e6ed9fec4a1 with Priority: HIGHEST for action port [ 1128.246932] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e2e5973c-5504-4cd5-9f92-77ba0193d841 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.247152] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.247275] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.247816] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.247816] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e2e5973c-5504-4cd5-9f92-77ba0193d841',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.248983] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2e5973c-5504-4cd5-9f92-77ba0193d841 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.249178] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.249298] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.249575] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.249804] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.251014] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.251014] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.251014] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.251014] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.251014] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2e5973c-5504-4cd5-9f92-77ba0193d841',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.252176] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-5d990423-d817-4301-8687-6e6ed9fec4a1 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.252330] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5d990423-d817-4301-8687-6e6ed9fec4a1" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.253391] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5d990423-d817-4301-8687-6e6ed9fec4a1" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.253391] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5d990423-d817-4301-8687-6e6ed9fec4a1" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.253391] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5d990423-d817-4301-8687-6e6ed9fec4a1',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.754525] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e2e5973c-5504-4cd5-9f92-77ba0193d841',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.755489] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2e5973c-5504-4cd5-9f92-77ba0193d841 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.755595] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.755944] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5d990423-d817-4301-8687-6e6ed9fec4a1 with status ACTIVE [ 1128.756124] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.756232] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.756766] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.756766] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.756766] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.756766] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.756960] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.756960] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.757031] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.757113] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.757294] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.757390] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.757453] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.757575] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.757647] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.757728] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5d990423-d817-4301-8687-6e6ed9fec4a1 is going to be updated. [ 1128.778901] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.779071] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.779133] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.779321] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.779458] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.779618] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5d990423-d817-4301-8687-6e6ed9fec4a1" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.257198] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e2e5973c-5504-4cd5-9f92-77ba0193d841',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.760229] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.760559] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.760636] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.760850] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.760949] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.761056] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2e5973c-5504-4cd5-9f92-77ba0193d841 is going to be updated. [ 1129.791858] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.792133] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.792237] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.792459] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.792642] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.802439] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2e5973c-5504-4cd5-9f92-77ba0193d841 in Status: IN_PROGRESS for 2s [ 1129.900766] env[65065]: INFO networking_nsxv3.common.synchronization [req-39e69b61-40db-4993-8cc1-55935bbd3a9a req-7fa42c49-5d68-4cad-9d87-57c34cb183a3 tempest-ServersTestJSON-1126920631 tempest-ServersTestJSON-1126920631-project-member] Enqueued Resource ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 with Priority: HIGHEST for action security_group_members [ 1129.901440] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 with Priority: HIGHEST for action security_group_members [ 1129.901755] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e5f0086-b1e3-4f00-8207-8306f153d0e4 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.901904] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.901958] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.902169] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.902377] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.902542] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.902608] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.902982] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.902982] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.903122] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e5f0086-b1e3-4f00-8207-8306f153d0e4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.405592] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.405592] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.405592] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.406348] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.406348] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.406348] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.406348] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.406348] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.406645] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.406689] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.406774] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 is going to be updated. [ 1130.434737] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.435032] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.435032] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.435161] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.435304] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.445681] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 in Status: IN_PROGRESS for 2s [ 1131.813108] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2e5973c-5504-4cd5-9f92-77ba0193d841 in Status: SUCCESS [ 1131.813451] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.813548] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.813824] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.814061] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.814212] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.814299] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.814482] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.814569] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.814657] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.814749] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e2e5973c-5504-4cd5-9f92-77ba0193d841',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.317698] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2e5973c-5504-4cd5-9f92-77ba0193d841 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.317698] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.317698] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.317698] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.317698] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.317698] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.317698] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.318097] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.318301] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.318505] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.318766] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2e5973c-5504-4cd5-9f92-77ba0193d841 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.318967] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.319143] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.319365] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.319626] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.319859] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.321025] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.321025] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.321025] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.321025] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.321025] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e2e5973c-5504-4cd5-9f92-77ba0193d841',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.457355] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 in Status: SUCCESS [ 1132.457551] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 deletion is rescheduled due to dependency. [ 1132.457686] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.823558] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e2e5973c-5504-4cd5-9f92-77ba0193d841: rpc.has_security_group_logging(os_id): False [ 1132.840595] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.840784] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.840825] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.841045] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.841159] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.841356] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.841511] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.841587] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.841762] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.841880] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.842112] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.842212] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.842274] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.842425] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.842500] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.842679] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.842774] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.842891] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.842996] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.843072] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.843155] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e2e5973c-5504-4cd5-9f92-77ba0193d841 is going to be updated. [ 1132.905825] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.906080] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.906127] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.906340] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.906485] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.923159] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2e5973c-5504-4cd5-9f92-77ba0193d841 in Status: IN_PROGRESS for 2s [ 1134.902416] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1134.902794] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1134.941094] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2e5973c-5504-4cd5-9f92-77ba0193d841 in Status: SUCCESS [ 1134.941094] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.903858] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1139.904206] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1143.980169] env[65065]: INFO networking_nsxv3.common.synchronization [req-cf3b0209-74cc-4883-8246-8db00fec2f93 req-462e9a8e-d722-4bc0-9ac5-eb493def5eb5 tempest-AttachInterfacesTestJSON-1590270829 tempest-AttachInterfacesTestJSON-1590270829-project-member] Enqueued Resource ID: 54addcf5-1b30-4561-a83f-43a8cf610f46 with Priority: HIGHEST for action security_group_members [ 1143.981077] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54addcf5-1b30-4561-a83f-43a8cf610f46 with Priority: HIGHEST for action security_group_members [ 1143.981376] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-54addcf5-1b30-4561-a83f-43a8cf610f46 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.982073] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54addcf5-1b30-4561-a83f-43a8cf610f46" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.982073] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54addcf5-1b30-4561-a83f-43a8cf610f46" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.982073] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54addcf5-1b30-4561-a83f-43a8cf610f46" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.982302] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.982388] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.982388] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.982596] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.984854] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.984854] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('54addcf5-1b30-4561-a83f-43a8cf610f46',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.487872] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('54addcf5-1b30-4561-a83f-43a8cf610f46',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.989842] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('54addcf5-1b30-4561-a83f-43a8cf610f46',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.492101] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.492312] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.492357] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.492570] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.492663] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.492762] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54addcf5-1b30-4561-a83f-43a8cf610f46 is going to be updated. [ 1145.526606] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.526980] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.527135] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.527428] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.527559] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.538391] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54addcf5-1b30-4561-a83f-43a8cf610f46 in Status: IN_PROGRESS for 2s [ 1147.552142] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54addcf5-1b30-4561-a83f-43a8cf610f46 in Status: SUCCESS [ 1147.552604] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54addcf5-1b30-4561-a83f-43a8cf610f46" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.982305] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1148.982701] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1150.252117] env[65065]: INFO networking_nsxv3.common.synchronization [req-734f9a16-d140-4997-8bea-e2737713647b req-b571fc96-2b49-43fb-9f7c-e3e962c9ae35 tempest-AttachInterfacesTestJSON-1590270829 tempest-AttachInterfacesTestJSON-1590270829-project-member] Enqueued Resource ID: 54addcf5-1b30-4561-a83f-43a8cf610f46 with Priority: HIGHEST for action security_group_members [ 1150.252879] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54addcf5-1b30-4561-a83f-43a8cf610f46 with Priority: HIGHEST for action security_group_members [ 1150.253364] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-54addcf5-1b30-4561-a83f-43a8cf610f46 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.253564] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54addcf5-1b30-4561-a83f-43a8cf610f46" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.253672] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54addcf5-1b30-4561-a83f-43a8cf610f46" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.253946] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54addcf5-1b30-4561-a83f-43a8cf610f46" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.254203] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.254361] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.254464] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.254694] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.254826] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.254971] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('54addcf5-1b30-4561-a83f-43a8cf610f46',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.758461] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.758461] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.758797] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.758797] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.758899] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.759100] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.759211] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.759273] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.759426] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.759503] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.759594] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54addcf5-1b30-4561-a83f-43a8cf610f46 is going to be updated. [ 1150.790318] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.790563] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.790634] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.790820] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.790963] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.801616] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54addcf5-1b30-4561-a83f-43a8cf610f46 in Status: IN_PROGRESS for 2s [ 1152.812610] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54addcf5-1b30-4561-a83f-43a8cf610f46 in Status: SUCCESS [ 1152.812969] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54addcf5-1b30-4561-a83f-43a8cf610f46 deletion is rescheduled due to dependency. [ 1152.812969] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54addcf5-1b30-4561-a83f-43a8cf610f46" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.158375] env[65065]: INFO networking_nsxv3.common.synchronization [req-7b4b0fc2-a450-4c1b-a2d4-2e81b571e4f5 req-154b3c1c-1bc0-48d5-8a40-5228f86e9f5c tempest-ServerActionsTestJSON-1279756280 tempest-ServerActionsTestJSON-1279756280-project-member] Enqueued Resource ID: c587345b-51c8-42f7-8a0c-052027c4b18c with Priority: HIGHEST for action security_group_members [ 1154.158375] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c587345b-51c8-42f7-8a0c-052027c4b18c with Priority: HIGHEST for action security_group_members [ 1154.158619] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-c587345b-51c8-42f7-8a0c-052027c4b18c taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.158671] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c587345b-51c8-42f7-8a0c-052027c4b18c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.158762] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c587345b-51c8-42f7-8a0c-052027c4b18c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.158919] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c587345b-51c8-42f7-8a0c-052027c4b18c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.159087] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.159186] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.159239] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.159389] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.159469] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.159603] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c587345b-51c8-42f7-8a0c-052027c4b18c',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.661791] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.661989] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.662043] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.662824] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.662824] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.662824] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.662824] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.662824] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.663419] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.663522] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.663604] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c587345b-51c8-42f7-8a0c-052027c4b18c is going to be updated. [ 1154.694218] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.694443] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.694542] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.694845] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.695068] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.704137] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c587345b-51c8-42f7-8a0c-052027c4b18c in Status: IN_PROGRESS for 2s [ 1154.724140] env[65065]: INFO networking_nsxv3.common.synchronization [None req-fd2757ad-2d08-4bf7-ac66-af022cc2f3f2 tempest-AttachInterfacesTestJSON-1590270829 tempest-AttachInterfacesTestJSON-1590270829-project-member] Enqueued Resource ID: e2e5973c-5504-4cd5-9f92-77ba0193d841 with Priority: HIGHEST for action security_group_members [ 1154.724719] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2e5973c-5504-4cd5-9f92-77ba0193d841 with Priority: HIGHEST for action security_group_members [ 1154.725136] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2e5973c-5504-4cd5-9f92-77ba0193d841 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.725261] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.725261] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.725418] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.725568] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.725658] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.725713] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.725878] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.726028] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.726125] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2e5973c-5504-4cd5-9f92-77ba0193d841',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.229040] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.229040] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.229040] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.229531] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.229531] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.229531] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.229645] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.229645] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.229770] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.229843] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.229929] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2e5973c-5504-4cd5-9f92-77ba0193d841 is going to be updated. [ 1155.256560] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.256764] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.256845] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.257074] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.257348] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.266119] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2e5973c-5504-4cd5-9f92-77ba0193d841 in Status: IN_PROGRESS for 2s [ 1156.714436] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c587345b-51c8-42f7-8a0c-052027c4b18c in Status: SUCCESS [ 1156.714726] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c587345b-51c8-42f7-8a0c-052027c4b18c deletion is rescheduled due to dependency. [ 1156.714880] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c587345b-51c8-42f7-8a0c-052027c4b18c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.276859] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2e5973c-5504-4cd5-9f92-77ba0193d841 in Status: SUCCESS [ 1157.276859] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2e5973c-5504-4cd5-9f92-77ba0193d841 deletion is rescheduled due to dependency. [ 1157.276859] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.873471] env[65065]: INFO networking_nsxv3.common.synchronization [None req-f56d608f-08e4-4478-94a3-fd09d70ba005 None None] Enqueued Resource ID: 64e7a8de-bdc8-41a2-a4bb-42cd8221483c with Priority: HIGHEST for action port [ 1158.873744] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64e7a8de-bdc8-41a2-a4bb-42cd8221483c with Priority: HIGHEST for action port [ 1158.874233] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-64e7a8de-bdc8-41a2-a4bb-42cd8221483c taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.874233] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-64e7a8de-bdc8-41a2-a4bb-42cd8221483c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.874233] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-64e7a8de-bdc8-41a2-a4bb-42cd8221483c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.874886] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-64e7a8de-bdc8-41a2-a4bb-42cd8221483c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.874886] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('64e7a8de-bdc8-41a2-a4bb-42cd8221483c',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.378324] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 64e7a8de-bdc8-41a2-a4bb-42cd8221483c [ 1159.378604] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.378749] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.378811] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.379037] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.379128] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.379226] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:64e7a8de-bdc8-41a2-a4bb-42cd8221483c already deleted. [ 1159.379305] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-64e7a8de-bdc8-41a2-a4bb-42cd8221483c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.205336] env[65065]: INFO networking_nsxv3.common.synchronization [None req-227546f6-95d4-44a9-a113-0ec37df0ea05 None None] Enqueued Resource ID: cc36b61b-5fef-4966-8035-ee9ddc25796e with Priority: HIGHEST for action port [ 1161.206178] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc36b61b-5fef-4966-8035-ee9ddc25796e with Priority: HIGHEST for action port [ 1161.206502] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-cc36b61b-5fef-4966-8035-ee9ddc25796e taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.207092] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cc36b61b-5fef-4966-8035-ee9ddc25796e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.207170] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cc36b61b-5fef-4966-8035-ee9ddc25796e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.207416] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cc36b61b-5fef-4966-8035-ee9ddc25796e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.207498] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cc36b61b-5fef-4966-8035-ee9ddc25796e',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.710068] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cc36b61b-5fef-4966-8035-ee9ddc25796e [ 1161.710172] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.710279] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.710507] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.710572] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.710631] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.710727] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cc36b61b-5fef-4966-8035-ee9ddc25796e already deleted. [ 1161.710805] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cc36b61b-5fef-4966-8035-ee9ddc25796e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.832145] env[65065]: INFO networking_nsxv3.common.synchronization [req-f1e43458-eed2-496e-a822-73198fcf899d req-2027f990-96ef-4ee6-8337-70a902475792 tempest-ServerActionsTestJSON-1279756280 tempest-ServerActionsTestJSON-1279756280-project-member] Enqueued Resource ID: c587345b-51c8-42f7-8a0c-052027c4b18c with Priority: HIGHEST for action security_group_members [ 1161.832818] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c587345b-51c8-42f7-8a0c-052027c4b18c with Priority: HIGHEST for action security_group_members [ 1161.833291] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-c587345b-51c8-42f7-8a0c-052027c4b18c taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.833419] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c587345b-51c8-42f7-8a0c-052027c4b18c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.833480] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c587345b-51c8-42f7-8a0c-052027c4b18c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.833676] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c587345b-51c8-42f7-8a0c-052027c4b18c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.833829] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.833925] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.833989] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.835490] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.835616] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.835759] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c587345b-51c8-42f7-8a0c-052027c4b18c',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.158573] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock network-502 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.158925] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "network-502" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.159106] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "network-502" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.159402] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "network-502" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.159676] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.159835] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.159946] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.160192] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.160486] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.160690] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1162.160759] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1162.160840] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1162.160943] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1162.161069] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1162.161173] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1162.161301] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1162.183373] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1162.183542] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1162.183677] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1162.183850] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "network-502" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.184198] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock port-862dea65-918d-4fc1-9fc0-35bb73f2eb57 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.184373] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "port-862dea65-918d-4fc1-9fc0-35bb73f2eb57" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.184491] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "port-862dea65-918d-4fc1-9fc0-35bb73f2eb57" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.184819] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "port-862dea65-918d-4fc1-9fc0-35bb73f2eb57" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.184958] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('862dea65-918d-4fc1-9fc0-35bb73f2eb57',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.339106] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.339486] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.339486] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.339486] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.339605] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.339771] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.339867] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.339930] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.340098] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.340189] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.340297] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c587345b-51c8-42f7-8a0c-052027c4b18c is going to be updated. [ 1162.371082] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.371353] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.371353] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.371532] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.371702] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.382376] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c587345b-51c8-42f7-8a0c-052027c4b18c in Status: IN_PROGRESS for 2s [ 1162.687194] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.687442] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.687572] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.687851] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.688019] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.688191] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Segment Port 862dea65-918d-4fc1-9fc0-35bb73f2eb57 not found, creating... [ 1162.688451] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.688610] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.688727] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.688943] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.689109] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.689413] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.689559] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.689675] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.689881] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.690030] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.690200] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Resource: SegmentPort with ID: 862dea65-918d-4fc1-9fc0-35bb73f2eb57 is going to be created. [ 1162.714533] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.714754] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.714878] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.715189] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.715423] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.715645] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "port-862dea65-918d-4fc1-9fc0-35bb73f2eb57" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.420631] env[65065]: INFO networking_nsxv3.common.synchronization [req-f1e43458-eed2-496e-a822-73198fcf899d req-88cb901e-c6de-4989-bb9b-bca50257256e service nova] Enqueued Resource ID: c587345b-51c8-42f7-8a0c-052027c4b18c with Priority: HIGHEST for action security_group_rules [ 1163.420874] env[65065]: INFO networking_nsxv3.common.synchronization [req-f1e43458-eed2-496e-a822-73198fcf899d req-88cb901e-c6de-4989-bb9b-bca50257256e service nova] Enqueued Resource ID: c587345b-51c8-42f7-8a0c-052027c4b18c with Priority: HIGHEST for action security_group_members [ 1163.421020] env[65065]: INFO networking_nsxv3.common.synchronization [req-f1e43458-eed2-496e-a822-73198fcf899d req-88cb901e-c6de-4989-bb9b-bca50257256e service nova] Enqueued Resource ID: 862dea65-918d-4fc1-9fc0-35bb73f2eb57 with Priority: HIGHEST for action port [ 1163.421754] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c587345b-51c8-42f7-8a0c-052027c4b18c with Priority: HIGHEST for action security_group_rules [ 1163.421948] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c587345b-51c8-42f7-8a0c-052027c4b18c with Priority: HIGHEST for action security_group_members [ 1163.422127] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 862dea65-918d-4fc1-9fc0-35bb73f2eb57 with Priority: HIGHEST for action port [ 1163.422535] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c587345b-51c8-42f7-8a0c-052027c4b18c taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.422709] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c587345b-51c8-42f7-8a0c-052027c4b18c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.422834] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c587345b-51c8-42f7-8a0c-052027c4b18c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.423106] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c587345b-51c8-42f7-8a0c-052027c4b18c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.423235] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c587345b-51c8-42f7-8a0c-052027c4b18c',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.424445] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-c587345b-51c8-42f7-8a0c-052027c4b18c taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.424593] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c587345b-51c8-42f7-8a0c-052027c4b18c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.424894] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-862dea65-918d-4fc1-9fc0-35bb73f2eb57 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.425060] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-862dea65-918d-4fc1-9fc0-35bb73f2eb57" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.425160] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-862dea65-918d-4fc1-9fc0-35bb73f2eb57" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.425409] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-862dea65-918d-4fc1-9fc0-35bb73f2eb57" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.425527] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('862dea65-918d-4fc1-9fc0-35bb73f2eb57',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.624489] env[65065]: INFO networking_nsxv3.common.synchronization [req-b5e071d1-b1cb-4701-8ba1-25904828498d req-d92ba1af-bad9-4f7a-ba26-c7f1a24e353f tempest-AttachVolumeShelveTestJSON-217038498 tempest-AttachVolumeShelveTestJSON-217038498-project-member] Enqueued Resource ID: d0abfe3e-a5d3-4a8d-bdc5-c03daff4976f with Priority: HIGHEST for action security_group_members [ 1163.625092] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0abfe3e-a5d3-4a8d-bdc5-c03daff4976f with Priority: HIGHEST for action security_group_members [ 1163.625405] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0abfe3e-a5d3-4a8d-bdc5-c03daff4976f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.625527] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0abfe3e-a5d3-4a8d-bdc5-c03daff4976f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.625594] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0abfe3e-a5d3-4a8d-bdc5-c03daff4976f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.625791] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0abfe3e-a5d3-4a8d-bdc5-c03daff4976f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.626201] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.626201] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.626201] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.626380] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.626380] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.626439] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d0abfe3e-a5d3-4a8d-bdc5-c03daff4976f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.927982] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-c587345b-51c8-42f7-8a0c-052027c4b18c taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.928182] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c587345b-51c8-42f7-8a0c-052027c4b18c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.928313] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 862dea65-918d-4fc1-9fc0-35bb73f2eb57 with status ACTIVE [ 1163.928477] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.928582] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.928645] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.928854] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.928943] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.929125] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.929220] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.929284] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.929437] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.929514] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.929696] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.929786] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.929845] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.929985] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.930074] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.930158] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 862dea65-918d-4fc1-9fc0-35bb73f2eb57 is going to be updated. [ 1163.951469] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.951633] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.951683] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.952446] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.952624] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.952963] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-862dea65-918d-4fc1-9fc0-35bb73f2eb57" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.129117] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.129117] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.129117] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.129617] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.129835] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.130220] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.130482] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.130596] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.130858] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.130992] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.131133] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0abfe3e-a5d3-4a8d-bdc5-c03daff4976f is going to be updated. [ 1164.159894] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.160137] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.160215] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.160468] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.160650] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.171235] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0abfe3e-a5d3-4a8d-bdc5-c03daff4976f in Status: IN_PROGRESS for 2s [ 1164.392100] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c587345b-51c8-42f7-8a0c-052027c4b18c in Status: SUCCESS [ 1164.392406] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c587345b-51c8-42f7-8a0c-052027c4b18c deletion is rescheduled due to dependency. [ 1164.392482] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c587345b-51c8-42f7-8a0c-052027c4b18c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.392615] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c587345b-51c8-42f7-8a0c-052027c4b18c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.392826] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c587345b-51c8-42f7-8a0c-052027c4b18c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.393188] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.393188] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.393188] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.393428] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.393428] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.393508] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c587345b-51c8-42f7-8a0c-052027c4b18c',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.895812] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c587345b-51c8-42f7-8a0c-052027c4b18c',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.330581] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock network-8 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.330778] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "network-8" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.330901] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "network-8" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.331190] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "network-8" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.331453] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.331608] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.331756] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.331943] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.332366] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.332602] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1165.332750] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1165.332871] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1165.332983] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1165.333107] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1165.333211] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1165.333349] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1165.360412] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1165.360585] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1165.360723] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1165.360896] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "network-8" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.361233] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock port-de102b29-6098-4434-b840-813059216126 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.361402] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "port-de102b29-6098-4434-b840-813059216126" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.361520] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "port-de102b29-6098-4434-b840-813059216126" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.362344] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "port-de102b29-6098-4434-b840-813059216126" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.362473] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('de102b29-6098-4434-b840-813059216126',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.398759] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c587345b-51c8-42f7-8a0c-052027c4b18c',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.865475] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.865708] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.865832] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.866521] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.866695] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.866988] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.867166] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.867293] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.867555] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.867685] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.867969] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.868139] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.868253] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.868469] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.868636] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.868920] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Resource: SegmentPort with ID: de102b29-6098-4434-b840-813059216126 is going to be updated. [ 1165.891714] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.891935] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.892163] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.892455] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.892689] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.892977] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "port-de102b29-6098-4434-b840-813059216126" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.900792] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.901220] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.901220] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.901348] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.901348] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.901452] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c587345b-51c8-42f7-8a0c-052027c4b18c is going to be updated. [ 1165.940448] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.940669] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.940669] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.940867] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.941024] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.950787] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c587345b-51c8-42f7-8a0c-052027c4b18c in Status: IN_PROGRESS for 2s [ 1166.181485] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0abfe3e-a5d3-4a8d-bdc5-c03daff4976f in Status: SUCCESS [ 1166.181608] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0abfe3e-a5d3-4a8d-bdc5-c03daff4976f deletion is rescheduled due to dependency. [ 1166.181717] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0abfe3e-a5d3-4a8d-bdc5-c03daff4976f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.566153] env[65065]: INFO networking_nsxv3.common.synchronization [req-aba1ba62-8ade-4546-965b-f665d026a166 req-1f683c47-6e99-42ee-b5b8-f3d569b2baf2 service nova] Enqueued Resource ID: b95b4f27-41f6-4a01-a1aa-aa16348ad807 with Priority: HIGHEST for action security_group_rules [ 1166.566335] env[65065]: INFO networking_nsxv3.common.synchronization [req-aba1ba62-8ade-4546-965b-f665d026a166 req-1f683c47-6e99-42ee-b5b8-f3d569b2baf2 service nova] Enqueued Resource ID: b95b4f27-41f6-4a01-a1aa-aa16348ad807 with Priority: HIGHEST for action security_group_members [ 1166.566474] env[65065]: INFO networking_nsxv3.common.synchronization [req-aba1ba62-8ade-4546-965b-f665d026a166 req-1f683c47-6e99-42ee-b5b8-f3d569b2baf2 service nova] Enqueued Resource ID: de102b29-6098-4434-b840-813059216126 with Priority: HIGHEST for action port [ 1166.566984] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b95b4f27-41f6-4a01-a1aa-aa16348ad807 with Priority: HIGHEST for action security_group_rules [ 1166.567136] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b95b4f27-41f6-4a01-a1aa-aa16348ad807 with Priority: HIGHEST for action security_group_members [ 1166.567231] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de102b29-6098-4434-b840-813059216126 with Priority: HIGHEST for action port [ 1166.567527] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b95b4f27-41f6-4a01-a1aa-aa16348ad807 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.567653] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b95b4f27-41f6-4a01-a1aa-aa16348ad807" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.568076] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b95b4f27-41f6-4a01-a1aa-aa16348ad807" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.568289] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b95b4f27-41f6-4a01-a1aa-aa16348ad807" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.568371] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b95b4f27-41f6-4a01-a1aa-aa16348ad807',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.569285] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-b95b4f27-41f6-4a01-a1aa-aa16348ad807 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.569410] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b95b4f27-41f6-4a01-a1aa-aa16348ad807" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.569438] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b95b4f27-41f6-4a01-a1aa-aa16348ad807" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.569588] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b95b4f27-41f6-4a01-a1aa-aa16348ad807" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.569734] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.569876] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.569931] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.570354] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.570449] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.570582] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b95b4f27-41f6-4a01-a1aa-aa16348ad807',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.571288] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-de102b29-6098-4434-b840-813059216126 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.571727] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-de102b29-6098-4434-b840-813059216126" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.571727] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-de102b29-6098-4434-b840-813059216126" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.571727] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-de102b29-6098-4434-b840-813059216126" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.571727] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('de102b29-6098-4434-b840-813059216126',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.073356] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b95b4f27-41f6-4a01-a1aa-aa16348ad807',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.074476] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-b95b4f27-41f6-4a01-a1aa-aa16348ad807 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.074615] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b95b4f27-41f6-4a01-a1aa-aa16348ad807" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.075177] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port de102b29-6098-4434-b840-813059216126 with status ACTIVE [ 1167.075177] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.075335] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.075335] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.076406] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.076406] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.076406] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.076406] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.076406] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.076406] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.076406] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.076406] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.076406] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.077118] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.077118] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.077118] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.077118] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: de102b29-6098-4434-b840-813059216126 is going to be updated. [ 1167.103432] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.103654] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.103654] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.103864] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.103998] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.104169] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-de102b29-6098-4434-b840-813059216126" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.576125] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b95b4f27-41f6-4a01-a1aa-aa16348ad807',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.960540] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c587345b-51c8-42f7-8a0c-052027c4b18c in Status: SUCCESS [ 1167.960783] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c587345b-51c8-42f7-8a0c-052027c4b18c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.960941] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c587345b-51c8-42f7-8a0c-052027c4b18c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.961186] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c587345b-51c8-42f7-8a0c-052027c4b18c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.961379] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.961497] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.961557] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.961711] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.961791] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.961874] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c587345b-51c8-42f7-8a0c-052027c4b18c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.961967] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c587345b-51c8-42f7-8a0c-052027c4b18c',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.079315] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.079620] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.079620] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.079773] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.079872] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.079979] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b95b4f27-41f6-4a01-a1aa-aa16348ad807 is going to be updated. [ 1168.084219] env[65065]: INFO networking_nsxv3.common.synchronization [req-f8a4c67e-301a-4b9d-a80a-bf4645b7f7d8 req-5bcd4ad2-50d3-4aeb-b835-c4909a361b99 tempest-ListServersNegativeTestJSON-1893752784 tempest-ListServersNegativeTestJSON-1893752784-project-member] Enqueued Resource ID: 2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4 with Priority: HIGHEST for action security_group_members [ 1168.084911] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4 with Priority: HIGHEST for action security_group_members [ 1168.085402] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.085402] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.085536] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.085672] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.085867] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.086369] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.086442] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.086614] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.087064] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.087187] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.114970] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.115402] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.115570] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.115865] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.116024] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.127018] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b95b4f27-41f6-4a01-a1aa-aa16348ad807 in Status: IN_PROGRESS for 2s [ 1168.400919] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock network-648 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.401135] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "network-648" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.401256] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "network-648" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.401628] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "network-648" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.401912] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.402122] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.402244] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.402666] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.403225] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.403225] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1168.403225] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1168.403424] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1168.403505] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1168.403705] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1168.403828] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1168.403964] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1168.426015] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1168.426015] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1168.426015] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1168.426015] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "network-648" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.426015] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock port-e4e86a22-c354-48f6-a525-a42b143db434 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.426295] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "port-e4e86a22-c354-48f6-a525-a42b143db434" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.426350] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "port-e4e86a22-c354-48f6-a525-a42b143db434" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.426653] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "port-e4e86a22-c354-48f6-a525-a42b143db434" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.426811] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e4e86a22-c354-48f6-a525-a42b143db434',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.464922] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c587345b-51c8-42f7-8a0c-052027c4b18c',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.589764] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.589941] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.589996] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.590258] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.590372] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.590653] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.590803] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.590868] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.591053] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.591133] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.591220] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4 already deleted. [ 1168.591342] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.929135] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.929282] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.929429] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.929700] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.929858] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.930033] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Segment Port e4e86a22-c354-48f6-a525-a42b143db434 not found, creating... [ 1168.930380] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.930645] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.930645] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.930820] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.930987] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.931314] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.931509] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.931638] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.931886] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.932047] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.932213] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Resource: SegmentPort with ID: e4e86a22-c354-48f6-a525-a42b143db434 is going to be created. [ 1168.953516] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.953783] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.953897] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.954303] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.954578] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.954853] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "port-e4e86a22-c354-48f6-a525-a42b143db434" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.967481] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c587345b-51c8-42f7-8a0c-052027c4b18c: rpc.has_security_group_logging(os_id): False [ 1168.986942] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.987126] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.987204] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.987447] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.987532] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.987786] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.987888] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.987936] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.988180] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.988240] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.988296] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c587345b-51c8-42f7-8a0c-052027c4b18c is going to be updated. [ 1169.072447] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.072749] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.072749] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.072981] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.073173] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.092705] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c587345b-51c8-42f7-8a0c-052027c4b18c in Status: IN_PROGRESS for 2s [ 1169.666193] env[65065]: INFO networking_nsxv3.common.synchronization [req-f8a4c67e-301a-4b9d-a80a-bf4645b7f7d8 req-3607c510-fff0-4c49-9992-571b3fe8771e service nova] Enqueued Resource ID: 2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4 with Priority: HIGHEST for action security_group_rules [ 1169.666193] env[65065]: INFO networking_nsxv3.common.synchronization [req-f8a4c67e-301a-4b9d-a80a-bf4645b7f7d8 req-3607c510-fff0-4c49-9992-571b3fe8771e service nova] Enqueued Resource ID: 2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4 with Priority: HIGHEST for action security_group_members [ 1169.666193] env[65065]: INFO networking_nsxv3.common.synchronization [req-f8a4c67e-301a-4b9d-a80a-bf4645b7f7d8 req-3607c510-fff0-4c49-9992-571b3fe8771e service nova] Enqueued Resource ID: e4e86a22-c354-48f6-a525-a42b143db434 with Priority: HIGHEST for action port [ 1169.666193] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4 with Priority: HIGHEST for action security_group_rules [ 1169.666193] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4 with Priority: HIGHEST for action security_group_members [ 1169.666193] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4e86a22-c354-48f6-a525-a42b143db434 with Priority: HIGHEST for action port [ 1169.666734] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.666891] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.666959] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.667250] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.667322] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.668801] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.669149] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.669209] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.669436] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.669702] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.669895] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.670037] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.670377] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.670575] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.670640] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.671643] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-e4e86a22-c354-48f6-a525-a42b143db434 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.671798] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e4e86a22-c354-48f6-a525-a42b143db434" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.672103] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e4e86a22-c354-48f6-a525-a42b143db434" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.672842] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e4e86a22-c354-48f6-a525-a42b143db434" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.672842] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e4e86a22-c354-48f6-a525-a42b143db434',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.137793] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b95b4f27-41f6-4a01-a1aa-aa16348ad807 in Status: SUCCESS [ 1170.138169] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b95b4f27-41f6-4a01-a1aa-aa16348ad807" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.138169] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b95b4f27-41f6-4a01-a1aa-aa16348ad807" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.138378] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b95b4f27-41f6-4a01-a1aa-aa16348ad807" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.138567] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.138682] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.138746] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.138891] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.138971] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.139066] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b95b4f27-41f6-4a01-a1aa-aa16348ad807" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.139154] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b95b4f27-41f6-4a01-a1aa-aa16348ad807',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.175092] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.176622] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.176622] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.176622] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e4e86a22-c354-48f6-a525-a42b143db434 with status ACTIVE [ 1170.176622] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.176622] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.176622] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.177106] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.177106] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.177106] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.177367] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.177367] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.177567] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.177567] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.178678] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.178678] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.178678] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.178678] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.178678] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.178678] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e4e86a22-c354-48f6-a525-a42b143db434 is going to be updated. [ 1170.209283] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.209656] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.209656] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.209874] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.210407] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.210407] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e4e86a22-c354-48f6-a525-a42b143db434" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.443940] env[65065]: INFO networking_nsxv3.common.synchronization [req-f8a4c67e-301a-4b9d-a80a-bf4645b7f7d8 req-53da0015-8751-41f2-84ed-b4a1ff1ce89d tempest-ListServersNegativeTestJSON-1893752784 tempest-ListServersNegativeTestJSON-1893752784-project-member] Enqueued Resource ID: 2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4 with Priority: HIGHEST for action security_group_members [ 1170.445992] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4 with Priority: HIGHEST for action security_group_members [ 1170.445992] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.445992] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.642453] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b95b4f27-41f6-4a01-a1aa-aa16348ad807',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.680704] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.805022] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock network-648 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.805248] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "network-648" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.805369] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "network-648" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.805639] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "network-648" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.805893] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.806098] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.806222] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.806436] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.806580] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.806784] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1170.806897] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1170.807008] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1170.807122] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1170.807259] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1170.807368] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1170.807499] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1170.830308] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1170.830700] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1170.830863] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1170.831195] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "network-648" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.831617] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock port-f7597b47-3d08-45ad-8e0a-8d9206c10073 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.831820] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "port-f7597b47-3d08-45ad-8e0a-8d9206c10073" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.831970] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "port-f7597b47-3d08-45ad-8e0a-8d9206c10073" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.832442] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "port-f7597b47-3d08-45ad-8e0a-8d9206c10073" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.832599] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f7597b47-3d08-45ad-8e0a-8d9206c10073',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.111935] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c587345b-51c8-42f7-8a0c-052027c4b18c in Status: SUCCESS [ 1171.112206] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c587345b-51c8-42f7-8a0c-052027c4b18c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.144435] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b95b4f27-41f6-4a01-a1aa-aa16348ad807: rpc.has_security_group_logging(os_id): False [ 1171.163605] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.163870] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.163870] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.164181] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.164319] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.164649] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.164802] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.164937] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.165161] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.165276] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.165420] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b95b4f27-41f6-4a01-a1aa-aa16348ad807 is going to be updated. [ 1171.183909] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.183909] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.183909] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.183909] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.184110] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.184110] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4 is going to be created. [ 1171.215509] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.215711] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.215711] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.215925] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.216105] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.227624] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4 in Status: UNINITIALIZED for 2s [ 1171.229351] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.229496] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.229540] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.229745] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.229882] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.244103] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b95b4f27-41f6-4a01-a1aa-aa16348ad807 in Status: IN_PROGRESS for 2s [ 1171.335930] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.336254] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.336254] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.336651] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.336815] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.336969] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Segment Port f7597b47-3d08-45ad-8e0a-8d9206c10073 not found, creating... [ 1171.337251] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.337415] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.337533] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.337843] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.338073] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.338433] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.338618] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.338736] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.338951] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.339101] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.339243] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Resource: SegmentPort with ID: f7597b47-3d08-45ad-8e0a-8d9206c10073 is going to be created. [ 1171.361994] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.361994] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.362146] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.362729] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.363011] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.363282] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "port-f7597b47-3d08-45ad-8e0a-8d9206c10073" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.089669] env[65065]: INFO networking_nsxv3.common.synchronization [req-f8a4c67e-301a-4b9d-a80a-bf4645b7f7d8 req-94cd06f0-9fe2-4903-801d-cc51f46164be service nova] Enqueued Resource ID: 2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4 with Priority: HIGHEST for action security_group_rules [ 1172.090186] env[65065]: INFO networking_nsxv3.common.synchronization [req-f8a4c67e-301a-4b9d-a80a-bf4645b7f7d8 req-94cd06f0-9fe2-4903-801d-cc51f46164be service nova] Enqueued Resource ID: 2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4 with Priority: HIGHEST for action security_group_members [ 1172.090186] env[65065]: INFO networking_nsxv3.common.synchronization [req-f8a4c67e-301a-4b9d-a80a-bf4645b7f7d8 req-94cd06f0-9fe2-4903-801d-cc51f46164be service nova] Enqueued Resource ID: f7597b47-3d08-45ad-8e0a-8d9206c10073 with Priority: HIGHEST for action port [ 1172.090768] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4 with Priority: HIGHEST for action security_group_rules [ 1172.090959] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4 with Priority: HIGHEST for action security_group_members [ 1172.091078] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7597b47-3d08-45ad-8e0a-8d9206c10073 with Priority: HIGHEST for action port [ 1172.091300] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.091459] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.091648] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.091739] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.091915] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-f7597b47-3d08-45ad-8e0a-8d9206c10073 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.092037] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f7597b47-3d08-45ad-8e0a-8d9206c10073" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.092098] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f7597b47-3d08-45ad-8e0a-8d9206c10073" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.092657] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f7597b47-3d08-45ad-8e0a-8d9206c10073" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.092657] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f7597b47-3d08-45ad-8e0a-8d9206c10073',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.595238] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f7597b47-3d08-45ad-8e0a-8d9206c10073 with status ACTIVE [ 1172.595238] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.595663] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.595663] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.595663] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.595663] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.595905] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.595994] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.595994] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.596171] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.596250] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.597389] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.597389] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.597389] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.597389] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.597389] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.597389] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f7597b47-3d08-45ad-8e0a-8d9206c10073 is going to be updated. [ 1172.637096] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.637344] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.637344] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.637567] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.637729] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.637966] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f7597b47-3d08-45ad-8e0a-8d9206c10073" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.725897] env[65065]: INFO networking_nsxv3.common.synchronization [req-f8a4c67e-301a-4b9d-a80a-bf4645b7f7d8 req-658a71db-292a-440b-9364-8799129330e9 tempest-ListServersNegativeTestJSON-1893752784 tempest-ListServersNegativeTestJSON-1893752784-project-member] Enqueued Resource ID: 2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4 with Priority: HIGHEST for action security_group_members [ 1172.726683] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4 with Priority: HIGHEST for action security_group_members [ 1172.726891] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.727047] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.048497] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock network-648 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.048680] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "network-648" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.048743] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "network-648" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.049076] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "network-648" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.049374] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.050044] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.050044] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.050044] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.050044] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.050262] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1173.050404] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1173.050604] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1173.050657] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1173.050764] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1173.050917] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1173.051134] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1173.072296] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1173.072565] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1173.072738] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1173.072982] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "network-648" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.073370] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock port-3ce38b33-bf79-44f8-a058-6eaa8386adec taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.073580] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "port-3ce38b33-bf79-44f8-a058-6eaa8386adec" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.073704] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "port-3ce38b33-bf79-44f8-a058-6eaa8386adec" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.074130] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "port-3ce38b33-bf79-44f8-a058-6eaa8386adec" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.074301] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3ce38b33-bf79-44f8-a058-6eaa8386adec',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.241038] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4 in Status: SUCCESS [ 1173.241038] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.241038] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.241038] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.241038] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.241038] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.241038] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.241038] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.241038] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.241038] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.241038] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.241759] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.241929] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.242148] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.242257] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.242322] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.242542] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.242627] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.242721] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.263854] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b95b4f27-41f6-4a01-a1aa-aa16348ad807 in Status: SUCCESS [ 1173.264198] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b95b4f27-41f6-4a01-a1aa-aa16348ad807" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.577058] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.577357] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.577466] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.577802] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.577994] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.578200] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Segment Port 3ce38b33-bf79-44f8-a058-6eaa8386adec not found, creating... [ 1173.578643] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.578847] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.579059] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.579352] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.579520] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.579873] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.580081] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.580235] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.580591] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.580797] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.580951] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Resource: SegmentPort with ID: 3ce38b33-bf79-44f8-a058-6eaa8386adec is going to be created. [ 1173.601800] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.602457] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.602457] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.602750] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.602843] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.603089] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "port-3ce38b33-bf79-44f8-a058-6eaa8386adec" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.745079] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.745297] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.745439] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.248852] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.751212] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.751542] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.751542] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.751672] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.751774] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.751881] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4 is going to be updated. [ 1174.785677] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.785878] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.785956] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.786239] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.786398] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.801318] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4 in Status: IN_PROGRESS for 2s [ 1174.806634] env[65065]: INFO networking_nsxv3.common.synchronization [req-f8a4c67e-301a-4b9d-a80a-bf4645b7f7d8 req-e1b64406-6bf7-4bfc-bdea-9beab78a231c service nova] Enqueued Resource ID: 2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4 with Priority: HIGHEST for action security_group_rules [ 1174.806826] env[65065]: INFO networking_nsxv3.common.synchronization [req-f8a4c67e-301a-4b9d-a80a-bf4645b7f7d8 req-e1b64406-6bf7-4bfc-bdea-9beab78a231c service nova] Enqueued Resource ID: 2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4 with Priority: HIGHEST for action security_group_members [ 1174.806961] env[65065]: INFO networking_nsxv3.common.synchronization [req-f8a4c67e-301a-4b9d-a80a-bf4645b7f7d8 req-e1b64406-6bf7-4bfc-bdea-9beab78a231c service nova] Enqueued Resource ID: 3ce38b33-bf79-44f8-a058-6eaa8386adec with Priority: HIGHEST for action port [ 1174.807714] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4 with Priority: HIGHEST for action security_group_rules [ 1174.808894] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4 with Priority: HIGHEST for action security_group_members [ 1174.809018] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ce38b33-bf79-44f8-a058-6eaa8386adec with Priority: HIGHEST for action port [ 1174.809383] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.809574] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.809900] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.810038] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.810591] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-3ce38b33-bf79-44f8-a058-6eaa8386adec taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.810716] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3ce38b33-bf79-44f8-a058-6eaa8386adec" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.810900] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3ce38b33-bf79-44f8-a058-6eaa8386adec" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.811168] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3ce38b33-bf79-44f8-a058-6eaa8386adec" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.812062] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3ce38b33-bf79-44f8-a058-6eaa8386adec',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.048391] env[65065]: INFO networking_nsxv3.common.synchronization [None req-a9826a46-a272-421e-8e20-60ab4f169c74 tempest-AttachVolumeShelveTestJSON-217038498 tempest-AttachVolumeShelveTestJSON-217038498-project-member] Enqueued Resource ID: 4c1875d8-72c6-4298-b87e-1bda7f9214d3 with Priority: HIGHEST for action security_group_rules [ 1175.048952] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c1875d8-72c6-4298-b87e-1bda7f9214d3 with Priority: HIGHEST for action security_group_rules [ 1175.049284] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4c1875d8-72c6-4298-b87e-1bda7f9214d3 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.049405] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4c1875d8-72c6-4298-b87e-1bda7f9214d3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.049473] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4c1875d8-72c6-4298-b87e-1bda7f9214d3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.049753] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4c1875d8-72c6-4298-b87e-1bda7f9214d3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.049837] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4c1875d8-72c6-4298-b87e-1bda7f9214d3',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.159660] env[65065]: INFO networking_nsxv3.common.synchronization [None req-a40e0d46-2dc5-4d2b-8f8e-ea837a059025 tempest-AttachVolumeShelveTestJSON-217038498 tempest-AttachVolumeShelveTestJSON-217038498-project-member] Enqueued Resource ID: 4c1875d8-72c6-4298-b87e-1bda7f9214d3 with Priority: HIGHEST for action security_group_rules [ 1175.160250] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c1875d8-72c6-4298-b87e-1bda7f9214d3 with Priority: HIGHEST for action security_group_rules [ 1175.160665] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4c1875d8-72c6-4298-b87e-1bda7f9214d3 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.160776] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4c1875d8-72c6-4298-b87e-1bda7f9214d3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.314921] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3ce38b33-bf79-44f8-a058-6eaa8386adec with status ACTIVE [ 1175.315212] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.315358] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.315430] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.315660] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.315774] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.315967] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.316085] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.316148] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.316334] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.316410] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.316595] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.316709] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.316778] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.316918] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.316992] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.317115] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3ce38b33-bf79-44f8-a058-6eaa8386adec is going to be updated. [ 1175.343481] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.343661] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.343722] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.343905] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.344060] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.344223] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3ce38b33-bf79-44f8-a058-6eaa8386adec" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.570489] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.570719] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.570719] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.570937] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.571056] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.571205] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4c1875d8-72c6-4298-b87e-1bda7f9214d3 already deleted. [ 1175.571205] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4c1875d8-72c6-4298-b87e-1bda7f9214d3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.571411] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4c1875d8-72c6-4298-b87e-1bda7f9214d3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.571646] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4c1875d8-72c6-4298-b87e-1bda7f9214d3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.571776] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4c1875d8-72c6-4298-b87e-1bda7f9214d3',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.095686] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.095966] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.095966] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.096182] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.096301] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.096429] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4c1875d8-72c6-4298-b87e-1bda7f9214d3 already deleted. [ 1176.096542] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4c1875d8-72c6-4298-b87e-1bda7f9214d3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.811406] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4 in Status: IN_PROGRESS for 4s [ 1178.824493] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4 in Status: SUCCESS [ 1178.824887] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.824943] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.825146] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.825340] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.825458] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.825522] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.825673] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.825778] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.825956] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.329632] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.832110] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.161264] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1180.161484] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=6 [ 1180.334552] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.334724] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.334797] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.335049] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.335147] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.335253] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4 is going to be updated. [ 1180.380787] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.381026] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.381026] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.381233] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.381384] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.390261] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4 in Status: IN_PROGRESS for 2s [ 1180.774504] env[65065]: INFO networking_nsxv3.common.synchronization [req-66eb4046-525f-4923-abdf-324c3597cece req-b33c5527-48c4-4b84-afc6-160976f28163 tempest-AttachVolumeShelveTestJSON-217038498 tempest-AttachVolumeShelveTestJSON-217038498-project-member] Enqueued Resource ID: 4c1875d8-72c6-4298-b87e-1bda7f9214d3 with Priority: HIGHEST for action security_group_members [ 1180.775840] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c1875d8-72c6-4298-b87e-1bda7f9214d3 with Priority: HIGHEST for action security_group_members [ 1180.776536] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c1875d8-72c6-4298-b87e-1bda7f9214d3 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.776900] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c1875d8-72c6-4298-b87e-1bda7f9214d3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.777016] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c1875d8-72c6-4298-b87e-1bda7f9214d3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.777752] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c1875d8-72c6-4298-b87e-1bda7f9214d3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.779097] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.779097] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.779097] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.779260] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.779260] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.779315] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4c1875d8-72c6-4298-b87e-1bda7f9214d3',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.119996] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock network-470 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.120331] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "network-470" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.120454] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "network-470" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.120783] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "network-470" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.121456] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.121686] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.121814] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.122091] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.122282] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.122558] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1181.122704] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1181.122819] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1181.122959] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1181.123114] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1181.123234] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1181.123399] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1181.144615] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1181.144800] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1181.145035] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1181.145214] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "network-470" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.145538] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock port-54f379b2-5dcf-45bb-b5e6-5d9ab3d9f558 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.145716] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "port-54f379b2-5dcf-45bb-b5e6-5d9ab3d9f558" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.145833] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "port-54f379b2-5dcf-45bb-b5e6-5d9ab3d9f558" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.146239] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "port-54f379b2-5dcf-45bb-b5e6-5d9ab3d9f558" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.146379] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('54f379b2-5dcf-45bb-b5e6-5d9ab3d9f558',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.281852] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.282097] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.282097] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.282319] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.282406] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.282646] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.282756] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.282793] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.282949] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.283040] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.283127] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c1875d8-72c6-4298-b87e-1bda7f9214d3 already deleted. [ 1181.283205] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c1875d8-72c6-4298-b87e-1bda7f9214d3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.648929] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.649262] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.649432] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.649919] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.650154] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.650366] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Segment Port 54f379b2-5dcf-45bb-b5e6-5d9ab3d9f558 not found, creating... [ 1181.650774] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.651021] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.651200] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.651506] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.651712] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.652161] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.652383] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.652592] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.652877] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.653077] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.653273] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Resource: SegmentPort with ID: 54f379b2-5dcf-45bb-b5e6-5d9ab3d9f558 is going to be created. [ 1181.674116] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.674381] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.674518] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.674797] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.675340] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.675734] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "port-54f379b2-5dcf-45bb-b5e6-5d9ab3d9f558" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.378858] env[65065]: INFO networking_nsxv3.common.synchronization [req-66eb4046-525f-4923-abdf-324c3597cece req-93bae5b9-6290-4238-816b-a218d78f98fc service nova] Enqueued Resource ID: 4c1875d8-72c6-4298-b87e-1bda7f9214d3 with Priority: HIGHEST for action security_group_rules [ 1182.379130] env[65065]: INFO networking_nsxv3.common.synchronization [req-66eb4046-525f-4923-abdf-324c3597cece req-93bae5b9-6290-4238-816b-a218d78f98fc service nova] Enqueued Resource ID: 4c1875d8-72c6-4298-b87e-1bda7f9214d3 with Priority: HIGHEST for action security_group_members [ 1182.379193] env[65065]: INFO networking_nsxv3.common.synchronization [req-66eb4046-525f-4923-abdf-324c3597cece req-93bae5b9-6290-4238-816b-a218d78f98fc service nova] Enqueued Resource ID: 54f379b2-5dcf-45bb-b5e6-5d9ab3d9f558 with Priority: HIGHEST for action port [ 1182.379729] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c1875d8-72c6-4298-b87e-1bda7f9214d3 with Priority: HIGHEST for action security_group_rules [ 1182.379864] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c1875d8-72c6-4298-b87e-1bda7f9214d3 with Priority: HIGHEST for action security_group_members [ 1182.379958] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54f379b2-5dcf-45bb-b5e6-5d9ab3d9f558 with Priority: HIGHEST for action port [ 1182.380237] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4c1875d8-72c6-4298-b87e-1bda7f9214d3 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.380355] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4c1875d8-72c6-4298-b87e-1bda7f9214d3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.380451] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4c1875d8-72c6-4298-b87e-1bda7f9214d3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.380667] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4c1875d8-72c6-4298-b87e-1bda7f9214d3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.380748] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4c1875d8-72c6-4298-b87e-1bda7f9214d3',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.381667] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c1875d8-72c6-4298-b87e-1bda7f9214d3 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.381802] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c1875d8-72c6-4298-b87e-1bda7f9214d3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.381870] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c1875d8-72c6-4298-b87e-1bda7f9214d3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.382049] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c1875d8-72c6-4298-b87e-1bda7f9214d3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.382194] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.382309] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.382385] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.382596] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.382728] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.382789] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4c1875d8-72c6-4298-b87e-1bda7f9214d3',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.383654] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-54f379b2-5dcf-45bb-b5e6-5d9ab3d9f558 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.383654] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-54f379b2-5dcf-45bb-b5e6-5d9ab3d9f558" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.383780] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-54f379b2-5dcf-45bb-b5e6-5d9ab3d9f558" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.383915] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-54f379b2-5dcf-45bb-b5e6-5d9ab3d9f558" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.384015] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('54f379b2-5dcf-45bb-b5e6-5d9ab3d9f558',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.401583] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4 in Status: SUCCESS [ 1182.401835] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.402773] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.403033] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.403207] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.403412] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.403469] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.403686] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.403686] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.403793] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.885317] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4c1875d8-72c6-4298-b87e-1bda7f9214d3',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.886763] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c1875d8-72c6-4298-b87e-1bda7f9214d3 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.886901] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c1875d8-72c6-4298-b87e-1bda7f9214d3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.887377] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 54f379b2-5dcf-45bb-b5e6-5d9ab3d9f558 with status ACTIVE [ 1182.887534] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.887679] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.887742] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.887960] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.888088] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.888282] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.888392] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.888469] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.888743] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.888917] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.889193] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.889356] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.889455] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.889716] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.889848] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.889990] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 54f379b2-5dcf-45bb-b5e6-5d9ab3d9f558 is going to be updated. [ 1182.906059] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.913996] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.914227] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.914279] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.914523] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.914692] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.914904] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-54f379b2-5dcf-45bb-b5e6-5d9ab3d9f558" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.388696] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4c1875d8-72c6-4298-b87e-1bda7f9214d3',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.408101] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.895873] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.895873] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.895873] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.895873] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.895873] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.895873] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c1875d8-72c6-4298-b87e-1bda7f9214d3 is going to be created. [ 1183.910377] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.913087] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.913087] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.913087] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.913087] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.913087] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4 is going to be updated. [ 1183.923030] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.923030] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.923030] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.923030] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.923030] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.930776] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c1875d8-72c6-4298-b87e-1bda7f9214d3 in Status: UNINITIALIZED for 2s [ 1183.940715] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.941134] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.941307] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.941597] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.941839] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.952748] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4 in Status: IN_PROGRESS for 2s [ 1184.644798] env[65065]: INFO networking_nsxv3.common.synchronization [req-e29a1c09-c97a-4324-bdbf-525a461759cd req-8719cebc-24ba-48fc-9f82-48495efca89b tempest-ServerActionsTestOtherB-1640131964 tempest-ServerActionsTestOtherB-1640131964-project-member] Enqueued Resource ID: b95b4f27-41f6-4a01-a1aa-aa16348ad807 with Priority: HIGHEST for action security_group_members [ 1184.645231] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b95b4f27-41f6-4a01-a1aa-aa16348ad807 with Priority: HIGHEST for action security_group_members [ 1184.645458] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-b95b4f27-41f6-4a01-a1aa-aa16348ad807 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.645583] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b95b4f27-41f6-4a01-a1aa-aa16348ad807" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.645646] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b95b4f27-41f6-4a01-a1aa-aa16348ad807" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.645838] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b95b4f27-41f6-4a01-a1aa-aa16348ad807" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.646214] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.646214] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.646214] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.646503] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.646503] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.646503] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b95b4f27-41f6-4a01-a1aa-aa16348ad807',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.150865] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.151134] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.151247] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.151538] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.151661] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.151958] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.152138] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.152247] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.152482] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.152645] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.152790] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b95b4f27-41f6-4a01-a1aa-aa16348ad807 is going to be updated. [ 1185.180939] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.181138] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.181187] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.181372] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.181515] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.190286] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b95b4f27-41f6-4a01-a1aa-aa16348ad807 in Status: IN_PROGRESS for 2s [ 1185.941506] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c1875d8-72c6-4298-b87e-1bda7f9214d3 in Status: SUCCESS [ 1185.941770] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c1875d8-72c6-4298-b87e-1bda7f9214d3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.941879] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c1875d8-72c6-4298-b87e-1bda7f9214d3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.942115] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c1875d8-72c6-4298-b87e-1bda7f9214d3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.942304] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.942419] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.942484] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.942697] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.942776] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.942859] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c1875d8-72c6-4298-b87e-1bda7f9214d3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.942950] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4c1875d8-72c6-4298-b87e-1bda7f9214d3',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.963086] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4 in Status: SUCCESS [ 1185.963294] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.963441] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.963685] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.963897] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.964023] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.964091] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.964246] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.964324] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.964407] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.964565] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.964646] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.964707] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.964842] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.965063] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.965123] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.965168] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.965307] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.965381] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.965459] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.965541] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.966334] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.966498] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.966643] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.966738] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.966800] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.966935] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.967015] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.967100] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.444942] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4c1875d8-72c6-4298-b87e-1bda7f9214d3',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.468505] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4: rpc.has_security_group_logging(os_id): False [ 1186.470208] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.489922] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.490135] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.490135] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.490356] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.490444] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.490843] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.490978] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.490978] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.491143] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.491218] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.491409] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.491501] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.491563] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.491699] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.491774] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.491944] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.492052] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.492113] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.492249] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.492323] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.492406] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4 is going to be created. [ 1186.551019] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.551258] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.551258] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.551483] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.551781] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.567342] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4 in Status: IN_PROGRESS for 2s [ 1186.946985] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4c1875d8-72c6-4298-b87e-1bda7f9214d3: rpc.has_security_group_logging(os_id): False [ 1186.966806] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.967107] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.967107] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.967269] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.967356] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.967600] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.967698] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.967761] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.967905] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.967977] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.968074] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4c1875d8-72c6-4298-b87e-1bda7f9214d3 is going to be created. [ 1186.972641] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.025680] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.025865] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.025903] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.026134] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.026314] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.037811] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4c1875d8-72c6-4298-b87e-1bda7f9214d3 in Status: IN_PROGRESS for 2s [ 1187.201706] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b95b4f27-41f6-4a01-a1aa-aa16348ad807 in Status: SUCCESS [ 1187.201889] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b95b4f27-41f6-4a01-a1aa-aa16348ad807 deletion is rescheduled due to dependency. [ 1187.201992] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b95b4f27-41f6-4a01-a1aa-aa16348ad807" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.411798] env[65065]: INFO networking_nsxv3.common.synchronization [req-0aaae493-710c-4f12-84c7-670429198b10 req-28ba1f60-08df-4d1d-91c1-7db7ca644725 tempest-ListServersNegativeTestJSON-1893752784 tempest-ListServersNegativeTestJSON-1893752784-project-member] Enqueued Resource ID: 2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4 with Priority: HIGHEST for action security_group_members [ 1187.412469] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4 with Priority: HIGHEST for action security_group_members [ 1187.412739] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.412849] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.474700] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.474907] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.474907] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.475159] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.475338] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.475490] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4 is going to be updated. [ 1187.506227] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.506431] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.506431] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.506646] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.506787] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.517182] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4 in Status: IN_PROGRESS for 2s [ 1188.581661] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4 in Status: SUCCESS [ 1188.581943] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.582071] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.582338] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.582435] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.051338] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4c1875d8-72c6-4298-b87e-1bda7f9214d3 in Status: SUCCESS [ 1189.051636] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4c1875d8-72c6-4298-b87e-1bda7f9214d3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.085490] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.085685] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.526674] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4 in Status: SUCCESS [ 1189.526920] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.527140] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.527352] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.527542] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.527655] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.527722] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.527866] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.527946] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.528051] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.030554] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.532718] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.035136] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.035475] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.035475] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.035622] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.035756] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.035891] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4 is going to be updated. [ 1191.063196] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.063378] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.063378] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.063698] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.063904] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.072463] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4 in Status: IN_PROGRESS for 2s [ 1192.413202] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1192.413553] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=3 [ 1193.083541] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4 in Status: SUCCESS [ 1193.083541] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.083685] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.085999] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.085999] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.085999] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.085999] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.085999] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.085999] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.085999] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.085999] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.587753] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.588079] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.588079] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.588266] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.588414] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.588518] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.588585] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.588726] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.588817] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.588906] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.589074] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.589169] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.589230] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.589372] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.589508] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.589597] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.589659] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.589794] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.589869] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.589950] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.590051] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.084401] env[65065]: INFO networking_nsxv3.common.synchronization [req-3aea22fc-cfc6-4a5d-8716-4cfc658e6ede req-16519315-089a-4d21-b15f-b0f6e93d7527 tempest-ListServersNegativeTestJSON-1893752784 tempest-ListServersNegativeTestJSON-1893752784-project-member] Enqueued Resource ID: 2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4 with Priority: HIGHEST for action security_group_members [ 1194.084953] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4 with Priority: HIGHEST for action security_group_members [ 1194.085925] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.085925] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.085925] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.085925] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.085925] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.085925] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.085925] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.086353] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.086353] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.086353] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.092292] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4: rpc.has_security_group_logging(os_id): False [ 1194.113043] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.113043] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.113201] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.113293] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.113381] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.113593] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.113712] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.113802] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.113988] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.114102] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.114324] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.114425] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.114479] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.114619] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.114748] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.114899] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.114992] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.115287] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.115508] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.115708] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.115861] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4 is going to be updated. [ 1194.228537] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.228749] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.228749] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.228879] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.229080] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.246367] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4 in Status: IN_PROGRESS for 2s [ 1194.500320] env[65065]: INFO networking_nsxv3.common.synchronization [req-9c14bf29-3358-4ab7-b67e-52d3450c710f req-efa4a3e2-9adf-4135-a5ea-b2abbd91760e tempest-ListServersNegativeTestJSON-1893752784 tempest-ListServersNegativeTestJSON-1893752784-project-member] Enqueued Resource ID: 2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4 with Priority: HIGHEST for action security_group_members [ 1194.500993] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4 with Priority: HIGHEST for action security_group_members [ 1194.501319] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.501424] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.588504] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.090382] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.476636] env[65065]: INFO networking_nsxv3.common.synchronization [req-bef8e21f-85c2-493f-9f40-e957251450b9 req-38c2ad19-97c7-47c1-bddd-3938f614b814 tempest-ServerActionsTestOtherA-78922671 tempest-ServerActionsTestOtherA-78922671-project-member] Enqueued Resource ID: 8356bfa0-0d42-40e4-bec9-fd902715779f with Priority: HIGHEST for action security_group_members [ 1195.477439] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8356bfa0-0d42-40e4-bec9-fd902715779f with Priority: HIGHEST for action security_group_members [ 1195.477790] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-8356bfa0-0d42-40e4-bec9-fd902715779f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.477961] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8356bfa0-0d42-40e4-bec9-fd902715779f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.478551] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8356bfa0-0d42-40e4-bec9-fd902715779f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.478551] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8356bfa0-0d42-40e4-bec9-fd902715779f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.478551] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.478765] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.478765] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.478957] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.479132] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.479229] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8356bfa0-0d42-40e4-bec9-fd902715779f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.594761] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.594761] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.594761] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.594761] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.594761] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.594761] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4 is going to be updated. [ 1195.627407] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.627605] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.627652] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.629827] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.629827] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.639055] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4 in Status: IN_PROGRESS for 2s [ 1195.985144] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.985144] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.985144] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.985144] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.985144] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.985144] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.985144] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.985144] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.985144] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.985817] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.985817] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8356bfa0-0d42-40e4-bec9-fd902715779f is going to be updated. [ 1196.013377] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.013551] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.013591] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.013769] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.013905] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.023823] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8356bfa0-0d42-40e4-bec9-fd902715779f in Status: IN_PROGRESS for 2s [ 1196.255752] env[65065]: INFO networking_nsxv3.common.synchronization [None req-fa93d8cc-cdcd-43c1-b532-17619804cc70 None None] Enqueued Resource ID: c1d4ca4f-2aa6-4164-9199-fbbede3ef482 with Priority: HIGHEST for action port [ 1196.256172] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1d4ca4f-2aa6-4164-9199-fbbede3ef482 with Priority: HIGHEST for action port [ 1196.256570] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-c1d4ca4f-2aa6-4164-9199-fbbede3ef482 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.256651] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c1d4ca4f-2aa6-4164-9199-fbbede3ef482" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.256651] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c1d4ca4f-2aa6-4164-9199-fbbede3ef482" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.256973] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c1d4ca4f-2aa6-4164-9199-fbbede3ef482" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.256973] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c1d4ca4f-2aa6-4164-9199-fbbede3ef482',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.261525] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4 in Status: SUCCESS [ 1196.261730] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.261885] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.262111] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.262194] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.759071] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c1d4ca4f-2aa6-4164-9199-fbbede3ef482 [ 1196.759346] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.759477] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.759548] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.759767] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.759855] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.759954] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c1d4ca4f-2aa6-4164-9199-fbbede3ef482 already deleted. [ 1196.760053] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c1d4ca4f-2aa6-4164-9199-fbbede3ef482" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.783605] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.783748] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.784070] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.784070] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.784171] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.784257] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4 is going to be deleted. [ 1196.844063] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.844244] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.844306] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.844499] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.844617] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.844702] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.649937] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4 in Status: SUCCESS [ 1197.649937] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.650843] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.650843] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.650977] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.651090] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.651172] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.651387] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.652656] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.652656] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.034206] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8356bfa0-0d42-40e4-bec9-fd902715779f in Status: SUCCESS [ 1198.034206] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8356bfa0-0d42-40e4-bec9-fd902715779f deletion is rescheduled due to dependency. [ 1198.034206] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8356bfa0-0d42-40e4-bec9-fd902715779f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.155247] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.155446] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.155446] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.155625] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.155724] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.155941] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.156067] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.156132] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.156350] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.156443] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.156533] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4 is going to be deleted. [ 1198.187260] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.187462] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.187501] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.187770] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.187955] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.188244] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e65fe5e-bae1-4ca2-a9be-ea922b89c6e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.644061] env[65065]: INFO networking_nsxv3.common.synchronization [None req-28b8a84a-597a-4b2b-bc36-93430aeb857d None None] Enqueued Resource ID: 1215187f-8761-49cb-8418-9e5bbadda150 with Priority: HIGHEST for action port [ 1198.644612] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1215187f-8761-49cb-8418-9e5bbadda150 with Priority: HIGHEST for action port [ 1198.644947] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-1215187f-8761-49cb-8418-9e5bbadda150 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.645231] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1215187f-8761-49cb-8418-9e5bbadda150" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.645308] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1215187f-8761-49cb-8418-9e5bbadda150" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.645573] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1215187f-8761-49cb-8418-9e5bbadda150" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.645677] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1215187f-8761-49cb-8418-9e5bbadda150',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.147913] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1215187f-8761-49cb-8418-9e5bbadda150 [ 1199.148313] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.148522] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.148633] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.148934] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.149097] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.149265] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1215187f-8761-49cb-8418-9e5bbadda150 already deleted. [ 1199.149389] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1215187f-8761-49cb-8418-9e5bbadda150" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.645910] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1203.646612] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1203.722656] env[65065]: INFO networking_nsxv3.common.synchronization [req-7da21c83-26aa-4869-aafb-271a52b5e654 req-72f5fd25-9532-4b84-ac3c-8c622af31da6 tempest-ServerRescueNegativeTestJSON-1519189094 tempest-ServerRescueNegativeTestJSON-1519189094-project-member] Enqueued Resource ID: a057519d-085e-4b14-acb1-755fbec909af with Priority: HIGHEST for action security_group_members [ 1203.723231] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a057519d-085e-4b14-acb1-755fbec909af with Priority: HIGHEST for action security_group_members [ 1203.723542] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-a057519d-085e-4b14-acb1-755fbec909af taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.723666] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a057519d-085e-4b14-acb1-755fbec909af" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.723730] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a057519d-085e-4b14-acb1-755fbec909af" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.723997] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a057519d-085e-4b14-acb1-755fbec909af" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.724438] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.724552] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.724618] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.724775] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.724879] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.724946] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a057519d-085e-4b14-acb1-755fbec909af',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.012616] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock network-987 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.012862] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "network-987" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.013017] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "network-987" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.013359] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "network-987" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.013633] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.013800] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.013922] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.014175] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.014325] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.014550] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1204.014676] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1204.014788] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1204.014897] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1204.015012] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1204.015137] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1204.015266] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1204.038601] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1204.038776] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1204.038911] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1204.039100] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "network-987" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.039408] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock port-dcdccbfd-8e41-4cf9-8993-fa7ba5ec4cb9 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.039579] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "port-dcdccbfd-8e41-4cf9-8993-fa7ba5ec4cb9" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.039697] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "port-dcdccbfd-8e41-4cf9-8993-fa7ba5ec4cb9" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.040051] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "port-dcdccbfd-8e41-4cf9-8993-fa7ba5ec4cb9" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.040197] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dcdccbfd-8e41-4cf9-8993-fa7ba5ec4cb9',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.226618] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.226868] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.226868] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.227066] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.227159] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.227361] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.227458] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.227544] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.227706] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.227804] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.227925] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a057519d-085e-4b14-acb1-755fbec909af already deleted. [ 1204.228029] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a057519d-085e-4b14-acb1-755fbec909af" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.542724] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.542965] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.543102] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.543339] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.543496] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.543650] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Segment Port dcdccbfd-8e41-4cf9-8993-fa7ba5ec4cb9 not found, creating... [ 1204.543935] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.544114] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.544233] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.544460] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.544598] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.544878] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.545045] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.545216] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.545398] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.545533] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.545670] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Resource: SegmentPort with ID: dcdccbfd-8e41-4cf9-8993-fa7ba5ec4cb9 is going to be created. [ 1204.565939] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.566240] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.566324] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.566588] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.566817] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.567058] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "port-dcdccbfd-8e41-4cf9-8993-fa7ba5ec4cb9" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.315174] env[65065]: INFO networking_nsxv3.common.synchronization [req-7da21c83-26aa-4869-aafb-271a52b5e654 req-1a7891f2-5170-4118-9032-9a0f7c44b481 service nova] Enqueued Resource ID: a057519d-085e-4b14-acb1-755fbec909af with Priority: HIGHEST for action security_group_rules [ 1205.315439] env[65065]: INFO networking_nsxv3.common.synchronization [req-7da21c83-26aa-4869-aafb-271a52b5e654 req-1a7891f2-5170-4118-9032-9a0f7c44b481 service nova] Enqueued Resource ID: a057519d-085e-4b14-acb1-755fbec909af with Priority: HIGHEST for action security_group_members [ 1205.315512] env[65065]: INFO networking_nsxv3.common.synchronization [req-7da21c83-26aa-4869-aafb-271a52b5e654 req-1a7891f2-5170-4118-9032-9a0f7c44b481 service nova] Enqueued Resource ID: dcdccbfd-8e41-4cf9-8993-fa7ba5ec4cb9 with Priority: HIGHEST for action port [ 1205.316085] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a057519d-085e-4b14-acb1-755fbec909af with Priority: HIGHEST for action security_group_rules [ 1205.316360] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a057519d-085e-4b14-acb1-755fbec909af with Priority: HIGHEST for action security_group_members [ 1205.316497] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dcdccbfd-8e41-4cf9-8993-fa7ba5ec4cb9 with Priority: HIGHEST for action port [ 1205.316813] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a057519d-085e-4b14-acb1-755fbec909af taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.316998] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a057519d-085e-4b14-acb1-755fbec909af" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.317056] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a057519d-085e-4b14-acb1-755fbec909af" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.317297] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a057519d-085e-4b14-acb1-755fbec909af" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.317381] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a057519d-085e-4b14-acb1-755fbec909af',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.318607] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-a057519d-085e-4b14-acb1-755fbec909af taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.318711] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a057519d-085e-4b14-acb1-755fbec909af" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.318781] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a057519d-085e-4b14-acb1-755fbec909af" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.318945] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a057519d-085e-4b14-acb1-755fbec909af" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.319122] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.319228] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.319280] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.319386] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.319466] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.319560] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a057519d-085e-4b14-acb1-755fbec909af',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.320288] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-dcdccbfd-8e41-4cf9-8993-fa7ba5ec4cb9 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.320413] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dcdccbfd-8e41-4cf9-8993-fa7ba5ec4cb9" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.320470] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dcdccbfd-8e41-4cf9-8993-fa7ba5ec4cb9" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.320934] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dcdccbfd-8e41-4cf9-8993-fa7ba5ec4cb9" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.320934] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dcdccbfd-8e41-4cf9-8993-fa7ba5ec4cb9',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.822088] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-a057519d-085e-4b14-acb1-755fbec909af taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.822277] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a057519d-085e-4b14-acb1-755fbec909af" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.823055] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a057519d-085e-4b14-acb1-755fbec909af',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.823480] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dcdccbfd-8e41-4cf9-8993-fa7ba5ec4cb9 with status ACTIVE [ 1205.823678] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.823793] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.823881] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.824063] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.824168] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.824362] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.824455] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.824513] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.825150] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.825150] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.825150] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.825150] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.825150] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.825349] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.825349] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.825349] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dcdccbfd-8e41-4cf9-8993-fa7ba5ec4cb9 is going to be updated. [ 1205.846551] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.846862] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.846862] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.847046] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.847086] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.847249] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dcdccbfd-8e41-4cf9-8993-fa7ba5ec4cb9" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.922102] env[65065]: INFO networking_nsxv3.common.synchronization [req-a6afa97c-aaa7-4934-bd6f-852dc97fe63c req-87db044b-b301-44b4-b8e8-c8b515123c9b tempest-ServerRescueNegativeTestJSON-1519189094 tempest-ServerRescueNegativeTestJSON-1519189094-project-member] Enqueued Resource ID: a057519d-085e-4b14-acb1-755fbec909af with Priority: HIGHEST for action security_group_members [ 1205.922614] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a057519d-085e-4b14-acb1-755fbec909af with Priority: HIGHEST for action security_group_members [ 1205.923377] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-a057519d-085e-4b14-acb1-755fbec909af taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.923377] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a057519d-085e-4b14-acb1-755fbec909af" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.220845] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock network-987 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.221293] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "network-987" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.221293] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "network-987" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.221474] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "network-987" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.221832] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.221920] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.221992] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.222199] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.222416] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.222559] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1206.222669] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1206.222772] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1206.222902] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1206.223034] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1206.223145] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1206.223278] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1206.241685] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1206.241851] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1206.241989] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1206.242171] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "network-987" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.242462] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock port-1e50b316-c4da-4a1c-b336-83fb015c7da5 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.242682] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "port-1e50b316-c4da-4a1c-b336-83fb015c7da5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.242738] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "port-1e50b316-c4da-4a1c-b336-83fb015c7da5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.243134] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "port-1e50b316-c4da-4a1c-b336-83fb015c7da5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.243272] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1e50b316-c4da-4a1c-b336-83fb015c7da5',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.327320] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a057519d-085e-4b14-acb1-755fbec909af',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.746236] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.746477] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.746604] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.746876] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.747040] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.747214] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Segment Port 1e50b316-c4da-4a1c-b336-83fb015c7da5 not found, creating... [ 1206.747480] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.747634] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.747749] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.747964] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.748121] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.748396] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.748554] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.748666] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.748863] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.748994] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.749144] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Resource: SegmentPort with ID: 1e50b316-c4da-4a1c-b336-83fb015c7da5 is going to be created. [ 1206.768297] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.768488] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.768612] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.768874] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.769111] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.769389] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "port-1e50b316-c4da-4a1c-b336-83fb015c7da5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.830541] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.830755] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.830798] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.831226] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.831357] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.831502] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a057519d-085e-4b14-acb1-755fbec909af is going to be created. [ 1206.854393] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.854580] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.854653] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.854904] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.855044] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.866672] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a057519d-085e-4b14-acb1-755fbec909af in Status: UNINITIALIZED for 2s [ 1207.481593] env[65065]: INFO networking_nsxv3.common.synchronization [req-a6afa97c-aaa7-4934-bd6f-852dc97fe63c req-7e6e9f85-0c97-4ce7-8a77-35538f3d88f6 service nova] Enqueued Resource ID: a057519d-085e-4b14-acb1-755fbec909af with Priority: HIGHEST for action security_group_rules [ 1207.481831] env[65065]: INFO networking_nsxv3.common.synchronization [req-a6afa97c-aaa7-4934-bd6f-852dc97fe63c req-7e6e9f85-0c97-4ce7-8a77-35538f3d88f6 service nova] Enqueued Resource ID: a057519d-085e-4b14-acb1-755fbec909af with Priority: HIGHEST for action security_group_members [ 1207.481893] env[65065]: INFO networking_nsxv3.common.synchronization [req-a6afa97c-aaa7-4934-bd6f-852dc97fe63c req-7e6e9f85-0c97-4ce7-8a77-35538f3d88f6 service nova] Enqueued Resource ID: 1e50b316-c4da-4a1c-b336-83fb015c7da5 with Priority: HIGHEST for action port [ 1207.482428] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a057519d-085e-4b14-acb1-755fbec909af with Priority: HIGHEST for action security_group_rules [ 1207.483097] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a057519d-085e-4b14-acb1-755fbec909af with Priority: HIGHEST for action security_group_members [ 1207.483249] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e50b316-c4da-4a1c-b336-83fb015c7da5 with Priority: HIGHEST for action port [ 1207.483543] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a057519d-085e-4b14-acb1-755fbec909af taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.484404] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a057519d-085e-4b14-acb1-755fbec909af" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.484404] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-a057519d-085e-4b14-acb1-755fbec909af taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.484404] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a057519d-085e-4b14-acb1-755fbec909af" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.484610] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-1e50b316-c4da-4a1c-b336-83fb015c7da5 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.484717] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1e50b316-c4da-4a1c-b336-83fb015c7da5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.484748] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1e50b316-c4da-4a1c-b336-83fb015c7da5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.484931] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1e50b316-c4da-4a1c-b336-83fb015c7da5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.485025] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1e50b316-c4da-4a1c-b336-83fb015c7da5',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.986897] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1e50b316-c4da-4a1c-b336-83fb015c7da5 with status ACTIVE [ 1207.987160] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.987309] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.987388] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.987607] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.987699] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.987879] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.987978] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.988053] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.988206] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.988282] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.988604] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.988735] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.988797] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.988940] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.989024] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.989115] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1e50b316-c4da-4a1c-b336-83fb015c7da5 is going to be updated. [ 1208.013318] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.013318] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.013318] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.013318] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.013318] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.013318] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1e50b316-c4da-4a1c-b336-83fb015c7da5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.108905] env[65065]: INFO networking_nsxv3.common.synchronization [req-5724c179-1d2c-4b7e-9f33-cf384bf9cce7 req-40494d17-8c42-4c1d-8daf-3755a9d750bb tempest-ServerActionsTestOtherA-78922671 tempest-ServerActionsTestOtherA-78922671-project-member] Enqueued Resource ID: 42051b03-8b5b-4d44-b3bc-8b87353afdd7 with Priority: HIGHEST for action security_group_members [ 1208.109478] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42051b03-8b5b-4d44-b3bc-8b87353afdd7 with Priority: HIGHEST for action security_group_members [ 1208.109782] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-42051b03-8b5b-4d44-b3bc-8b87353afdd7 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.109904] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-42051b03-8b5b-4d44-b3bc-8b87353afdd7" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.109972] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-42051b03-8b5b-4d44-b3bc-8b87353afdd7" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.110190] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-42051b03-8b5b-4d44-b3bc-8b87353afdd7" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.110400] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.110455] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.110485] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.110633] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.110714] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.110830] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('42051b03-8b5b-4d44-b3bc-8b87353afdd7',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.395802] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock network-33 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.396012] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "network-33" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.396140] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "network-33" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.396407] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "network-33" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.396658] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.396810] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.396931] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.397203] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.397352] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.397542] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1208.397661] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1208.397765] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1208.397965] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1208.398090] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1208.398193] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1208.398320] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1208.416713] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1208.417311] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1208.417311] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1208.417311] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "network-33" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.417466] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock port-67d590de-f032-4da6-a0ef-2fede8a16b7f taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.417631] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "port-67d590de-f032-4da6-a0ef-2fede8a16b7f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.417749] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "port-67d590de-f032-4da6-a0ef-2fede8a16b7f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.418065] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "port-67d590de-f032-4da6-a0ef-2fede8a16b7f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.418237] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('67d590de-f032-4da6-a0ef-2fede8a16b7f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.612744] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.613263] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.613263] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.613263] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.613442] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.613539] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.613603] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.613636] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.613883] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.613883] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.614027] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 42051b03-8b5b-4d44-b3bc-8b87353afdd7 is going to be updated. [ 1208.643766] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.643766] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.643766] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.643766] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.643766] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.659103] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 42051b03-8b5b-4d44-b3bc-8b87353afdd7 in Status: IN_PROGRESS for 2s [ 1208.877847] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a057519d-085e-4b14-acb1-755fbec909af in Status: SUCCESS [ 1208.878122] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a057519d-085e-4b14-acb1-755fbec909af" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.878340] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a057519d-085e-4b14-acb1-755fbec909af" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.878616] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a057519d-085e-4b14-acb1-755fbec909af" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.878831] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.878954] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.879038] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.879201] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.879288] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.879420] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a057519d-085e-4b14-acb1-755fbec909af" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.879533] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a057519d-085e-4b14-acb1-755fbec909af',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.880529] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a057519d-085e-4b14-acb1-755fbec909af" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.880715] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a057519d-085e-4b14-acb1-755fbec909af" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.881365] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.881365] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.881365] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.881634] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.881804] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.881981] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a057519d-085e-4b14-acb1-755fbec909af',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.920998] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.921299] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.921492] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.921769] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.921923] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.922136] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Segment Port 67d590de-f032-4da6-a0ef-2fede8a16b7f not found, creating... [ 1208.922427] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.922628] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.922749] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.923091] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.923267] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.923601] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.923788] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.924011] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.924243] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.924435] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.924608] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Resource: SegmentPort with ID: 67d590de-f032-4da6-a0ef-2fede8a16b7f is going to be created. [ 1208.947249] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.947513] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.947574] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.948935] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.948935] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.948935] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "port-67d590de-f032-4da6-a0ef-2fede8a16b7f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.384725] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-a057519d-085e-4b14-acb1-755fbec909af taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.384960] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a057519d-085e-4b14-acb1-755fbec909af" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.385136] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a057519d-085e-4b14-acb1-755fbec909af',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.659064] env[65065]: INFO networking_nsxv3.common.synchronization [req-5724c179-1d2c-4b7e-9f33-cf384bf9cce7 req-788a33fd-ea7a-4a9a-8682-0e8159897e32 service nova] Enqueued Resource ID: 42051b03-8b5b-4d44-b3bc-8b87353afdd7 with Priority: HIGHEST for action security_group_rules [ 1209.659064] env[65065]: INFO networking_nsxv3.common.synchronization [req-5724c179-1d2c-4b7e-9f33-cf384bf9cce7 req-788a33fd-ea7a-4a9a-8682-0e8159897e32 service nova] Enqueued Resource ID: 42051b03-8b5b-4d44-b3bc-8b87353afdd7 with Priority: HIGHEST for action security_group_members [ 1209.659064] env[65065]: INFO networking_nsxv3.common.synchronization [req-5724c179-1d2c-4b7e-9f33-cf384bf9cce7 req-788a33fd-ea7a-4a9a-8682-0e8159897e32 service nova] Enqueued Resource ID: 67d590de-f032-4da6-a0ef-2fede8a16b7f with Priority: HIGHEST for action port [ 1209.659064] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42051b03-8b5b-4d44-b3bc-8b87353afdd7 with Priority: HIGHEST for action security_group_rules [ 1209.659064] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42051b03-8b5b-4d44-b3bc-8b87353afdd7 with Priority: HIGHEST for action security_group_members [ 1209.659517] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67d590de-f032-4da6-a0ef-2fede8a16b7f with Priority: HIGHEST for action port [ 1209.659517] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-42051b03-8b5b-4d44-b3bc-8b87353afdd7 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.659517] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-42051b03-8b5b-4d44-b3bc-8b87353afdd7" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.659643] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-42051b03-8b5b-4d44-b3bc-8b87353afdd7" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.659775] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-42051b03-8b5b-4d44-b3bc-8b87353afdd7" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.659870] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('42051b03-8b5b-4d44-b3bc-8b87353afdd7',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.662038] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-42051b03-8b5b-4d44-b3bc-8b87353afdd7 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.662038] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-42051b03-8b5b-4d44-b3bc-8b87353afdd7" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.662038] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-67d590de-f032-4da6-a0ef-2fede8a16b7f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.662038] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-67d590de-f032-4da6-a0ef-2fede8a16b7f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.662038] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-67d590de-f032-4da6-a0ef-2fede8a16b7f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.662038] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-67d590de-f032-4da6-a0ef-2fede8a16b7f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.662038] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('67d590de-f032-4da6-a0ef-2fede8a16b7f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.888184] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a057519d-085e-4b14-acb1-755fbec909af',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.164712] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-42051b03-8b5b-4d44-b3bc-8b87353afdd7 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.164962] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-42051b03-8b5b-4d44-b3bc-8b87353afdd7" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.165028] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 67d590de-f032-4da6-a0ef-2fede8a16b7f with status ACTIVE [ 1210.165234] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.165363] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.165454] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.165697] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.165815] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.166016] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.166153] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.166247] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.166449] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.166527] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.166732] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.166798] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.166861] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.167016] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.167086] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.167174] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 67d590de-f032-4da6-a0ef-2fede8a16b7f is going to be updated. [ 1210.188543] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.188733] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.188733] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.188945] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.189089] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.189251] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-67d590de-f032-4da6-a0ef-2fede8a16b7f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.390844] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.390933] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.391042] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.391345] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.391441] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.391546] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a057519d-085e-4b14-acb1-755fbec909af is going to be updated. [ 1210.421172] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.421321] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.421382] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.421590] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.421729] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.431915] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a057519d-085e-4b14-acb1-755fbec909af in Status: IN_PROGRESS for 2s [ 1210.672524] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 42051b03-8b5b-4d44-b3bc-8b87353afdd7 in Status: SUCCESS [ 1210.672831] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 42051b03-8b5b-4d44-b3bc-8b87353afdd7 deletion is rescheduled due to dependency. [ 1210.672831] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-42051b03-8b5b-4d44-b3bc-8b87353afdd7" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.673056] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-42051b03-8b5b-4d44-b3bc-8b87353afdd7" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.673283] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-42051b03-8b5b-4d44-b3bc-8b87353afdd7" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.673533] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.673714] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.673817] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.674129] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.674265] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.674428] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('42051b03-8b5b-4d44-b3bc-8b87353afdd7',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.176727] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('42051b03-8b5b-4d44-b3bc-8b87353afdd7',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.678925] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('42051b03-8b5b-4d44-b3bc-8b87353afdd7',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.181819] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.181977] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.182114] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.182321] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.182408] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.182552] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 42051b03-8b5b-4d44-b3bc-8b87353afdd7 is going to be updated. [ 1212.209065] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.209223] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.209293] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.209498] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.209641] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.217544] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 42051b03-8b5b-4d44-b3bc-8b87353afdd7 in Status: IN_PROGRESS for 2s [ 1212.443073] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a057519d-085e-4b14-acb1-755fbec909af in Status: SUCCESS [ 1212.443073] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a057519d-085e-4b14-acb1-755fbec909af" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.443073] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a057519d-085e-4b14-acb1-755fbec909af" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.443348] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a057519d-085e-4b14-acb1-755fbec909af" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.443588] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.443719] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.443781] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.443971] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.444065] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.444184] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a057519d-085e-4b14-acb1-755fbec909af',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.946257] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a057519d-085e-4b14-acb1-755fbec909af',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1213.449078] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a057519d-085e-4b14-acb1-755fbec909af',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1213.951417] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.951859] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.951859] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.951859] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.951968] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.952041] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a057519d-085e-4b14-acb1-755fbec909af is going to be updated. [ 1213.981362] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.981563] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.981607] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.981859] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.982060] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.992428] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a057519d-085e-4b14-acb1-755fbec909af in Status: IN_PROGRESS for 2s [ 1214.228017] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 42051b03-8b5b-4d44-b3bc-8b87353afdd7 in Status: SUCCESS [ 1214.228238] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-42051b03-8b5b-4d44-b3bc-8b87353afdd7" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.228402] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-42051b03-8b5b-4d44-b3bc-8b87353afdd7" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.228628] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-42051b03-8b5b-4d44-b3bc-8b87353afdd7" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.228822] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.228940] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.229028] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.229188] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.229269] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.229355] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-42051b03-8b5b-4d44-b3bc-8b87353afdd7" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.229445] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('42051b03-8b5b-4d44-b3bc-8b87353afdd7',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.659873] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1214.660029] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=4 [ 1214.731495] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-42051b03-8b5b-4d44-b3bc-8b87353afdd7 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.731774] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-42051b03-8b5b-4d44-b3bc-8b87353afdd7" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.731774] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-42051b03-8b5b-4d44-b3bc-8b87353afdd7" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.732020] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-42051b03-8b5b-4d44-b3bc-8b87353afdd7" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.732253] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.732372] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.732428] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.732582] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.732710] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.732861] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-42051b03-8b5b-4d44-b3bc-8b87353afdd7" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.733081] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-42051b03-8b5b-4d44-b3bc-8b87353afdd7 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.733181] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-42051b03-8b5b-4d44-b3bc-8b87353afdd7" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.733240] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-42051b03-8b5b-4d44-b3bc-8b87353afdd7" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.733442] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-42051b03-8b5b-4d44-b3bc-8b87353afdd7" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.733594] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.733666] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.733731] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.733922] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.733998] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.734102] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-42051b03-8b5b-4d44-b3bc-8b87353afdd7" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.734223] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('42051b03-8b5b-4d44-b3bc-8b87353afdd7',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.236744] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 42051b03-8b5b-4d44-b3bc-8b87353afdd7: rpc.has_security_group_logging(os_id): False [ 1215.255595] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.255736] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.255804] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.256035] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.256119] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.256335] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.256466] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.256505] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.256631] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.256704] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.258617] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.258617] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.258617] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.258617] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.258617] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.258617] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.258617] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.258617] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.258617] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.258617] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.258617] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 42051b03-8b5b-4d44-b3bc-8b87353afdd7 is going to be updated. [ 1215.324480] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.324691] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.324766] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.324953] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.325145] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.337994] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 42051b03-8b5b-4d44-b3bc-8b87353afdd7 in Status: IN_PROGRESS for 2s [ 1216.003292] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a057519d-085e-4b14-acb1-755fbec909af in Status: SUCCESS [ 1216.003526] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a057519d-085e-4b14-acb1-755fbec909af" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.003674] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a057519d-085e-4b14-acb1-755fbec909af" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.003901] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a057519d-085e-4b14-acb1-755fbec909af" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.004113] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.004235] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.004296] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.004462] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.004565] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.004656] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a057519d-085e-4b14-acb1-755fbec909af" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.004812] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-a057519d-085e-4b14-acb1-755fbec909af taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.004908] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a057519d-085e-4b14-acb1-755fbec909af" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.004964] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a057519d-085e-4b14-acb1-755fbec909af" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.005117] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a057519d-085e-4b14-acb1-755fbec909af" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.005254] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.005345] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.005402] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.005580] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.005724] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.005775] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a057519d-085e-4b14-acb1-755fbec909af" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.006089] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a057519d-085e-4b14-acb1-755fbec909af',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.508269] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a057519d-085e-4b14-acb1-755fbec909af: rpc.has_security_group_logging(os_id): False [ 1216.525308] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.525540] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.525540] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.525686] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.525791] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.526035] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.526163] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.526217] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.526373] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.526482] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.526678] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.526781] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.526858] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.527114] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.527114] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.527283] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.527374] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.527427] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.527567] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.527636] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.527720] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a057519d-085e-4b14-acb1-755fbec909af is going to be created. [ 1216.612286] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.612523] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.612523] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.612694] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.612868] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.623147] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a057519d-085e-4b14-acb1-755fbec909af in Status: IN_PROGRESS for 2s [ 1217.352116] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 42051b03-8b5b-4d44-b3bc-8b87353afdd7 in Status: SUCCESS [ 1217.352473] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-42051b03-8b5b-4d44-b3bc-8b87353afdd7" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.637313] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a057519d-085e-4b14-acb1-755fbec909af in Status: SUCCESS [ 1218.637707] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a057519d-085e-4b14-acb1-755fbec909af" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.637933] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a057519d-085e-4b14-acb1-755fbec909af" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.638075] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a057519d-085e-4b14-acb1-755fbec909af" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.638075] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a057519d-085e-4b14-acb1-755fbec909af',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1218.646509] env[65065]: INFO networking_nsxv3.common.synchronization [req-d76681e6-3bc0-44a8-9120-78eee9c77343 req-2aca041d-b56b-4f56-a08e-aecdcd777d1f tempest-ServerActionsTestOtherA-78922671 tempest-ServerActionsTestOtherA-78922671-project-member] Enqueued Resource ID: 42051b03-8b5b-4d44-b3bc-8b87353afdd7 with Priority: HIGHEST for action security_group_members [ 1218.647118] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42051b03-8b5b-4d44-b3bc-8b87353afdd7 with Priority: HIGHEST for action security_group_members [ 1218.647485] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-42051b03-8b5b-4d44-b3bc-8b87353afdd7 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.647617] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-42051b03-8b5b-4d44-b3bc-8b87353afdd7" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.647736] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-42051b03-8b5b-4d44-b3bc-8b87353afdd7" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.647966] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-42051b03-8b5b-4d44-b3bc-8b87353afdd7" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.648159] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.648299] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.648374] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.648565] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.648677] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.648789] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('42051b03-8b5b-4d44-b3bc-8b87353afdd7',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1218.699739] env[65065]: INFO networking_nsxv3.common.synchronization [req-d76681e6-3bc0-44a8-9120-78eee9c77343 req-2aca041d-b56b-4f56-a08e-aecdcd777d1f tempest-ServerActionsTestOtherA-78922671 tempest-ServerActionsTestOtherA-78922671-project-member] Enqueued Resource ID: 67d590de-f032-4da6-a0ef-2fede8a16b7f with Priority: HIGHEST for action port [ 1218.700615] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67d590de-f032-4da6-a0ef-2fede8a16b7f with Priority: HIGHEST for action port [ 1218.701055] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-67d590de-f032-4da6-a0ef-2fede8a16b7f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.701230] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-67d590de-f032-4da6-a0ef-2fede8a16b7f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.701286] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-67d590de-f032-4da6-a0ef-2fede8a16b7f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.701485] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-67d590de-f032-4da6-a0ef-2fede8a16b7f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.701568] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('67d590de-f032-4da6-a0ef-2fede8a16b7f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.140393] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-a057519d-085e-4b14-acb1-755fbec909af taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.140574] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a057519d-085e-4b14-acb1-755fbec909af" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.140635] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a057519d-085e-4b14-acb1-755fbec909af" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.140843] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a057519d-085e-4b14-acb1-755fbec909af" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.141015] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.141125] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.141182] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.141338] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.141425] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.141511] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a057519d-085e-4b14-acb1-755fbec909af" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.141602] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a057519d-085e-4b14-acb1-755fbec909af',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.151454] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.151601] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.151669] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.151854] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.151941] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.152145] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.152241] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.152300] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.152449] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.152521] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.152781] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 42051b03-8b5b-4d44-b3bc-8b87353afdd7 is going to be updated. [ 1219.195562] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.195988] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.195988] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.195988] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.196167] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.203723] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 67d590de-f032-4da6-a0ef-2fede8a16b7f with status ACTIVE [ 1219.203936] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.204136] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.204211] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.204424] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.204514] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.204686] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.204778] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.204840] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.204979] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.205067] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.205244] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.205334] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.205433] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.205532] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.205605] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.205687] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 67d590de-f032-4da6-a0ef-2fede8a16b7f is going to be updated. [ 1219.207272] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 42051b03-8b5b-4d44-b3bc-8b87353afdd7 in Status: IN_PROGRESS for 2s [ 1219.225365] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.225523] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.225608] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.225804] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.225935] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.226097] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-67d590de-f032-4da6-a0ef-2fede8a16b7f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.644061] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-a057519d-085e-4b14-acb1-755fbec909af taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.644372] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a057519d-085e-4b14-acb1-755fbec909af" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.644372] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a057519d-085e-4b14-acb1-755fbec909af" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.644614] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a057519d-085e-4b14-acb1-755fbec909af" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.644897] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.645147] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.645311] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.645602] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.645768] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.645935] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a057519d-085e-4b14-acb1-755fbec909af" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.646265] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-a057519d-085e-4b14-acb1-755fbec909af taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.646393] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a057519d-085e-4b14-acb1-755fbec909af" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.646469] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a057519d-085e-4b14-acb1-755fbec909af" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.646660] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a057519d-085e-4b14-acb1-755fbec909af" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.646806] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.646928] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.646995] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.647264] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.647264] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.647363] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a057519d-085e-4b14-acb1-755fbec909af" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.647463] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a057519d-085e-4b14-acb1-755fbec909af',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.152279] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a057519d-085e-4b14-acb1-755fbec909af: rpc.has_security_group_logging(os_id): False [ 1220.170345] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.170542] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.170542] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.170790] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.170927] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.171132] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.171244] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.171338] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.171527] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.171634] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.171833] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.171927] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.171987] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.172145] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.172221] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.172405] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.172496] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.172556] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.172691] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.172765] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.172850] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a057519d-085e-4b14-acb1-755fbec909af is going to be updated. [ 1220.239985] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.240152] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.240451] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.240451] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.240583] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.254460] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a057519d-085e-4b14-acb1-755fbec909af in Status: IN_PROGRESS for 2s [ 1221.219049] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 42051b03-8b5b-4d44-b3bc-8b87353afdd7 in Status: SUCCESS [ 1221.219437] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 42051b03-8b5b-4d44-b3bc-8b87353afdd7 deletion is rescheduled due to dependency. [ 1221.219437] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-42051b03-8b5b-4d44-b3bc-8b87353afdd7" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.270921] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a057519d-085e-4b14-acb1-755fbec909af in Status: SUCCESS [ 1222.271274] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a057519d-085e-4b14-acb1-755fbec909af" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.701389] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1223.701671] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1225.769023] env[65065]: INFO networking_nsxv3.common.synchronization [req-daf41b9e-5d0a-434e-ae84-79f1e71b2a29 req-f0f05a62-d241-4a58-8f67-351790789e11 tempest-ServerActionsTestJSON-1279756280 tempest-ServerActionsTestJSON-1279756280-project-member] Enqueued Resource ID: c587345b-51c8-42f7-8a0c-052027c4b18c with Priority: HIGHEST for action security_group_members [ 1225.770325] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c587345b-51c8-42f7-8a0c-052027c4b18c with Priority: HIGHEST for action security_group_members [ 1225.770756] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-c587345b-51c8-42f7-8a0c-052027c4b18c taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.770941] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c587345b-51c8-42f7-8a0c-052027c4b18c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.771089] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c587345b-51c8-42f7-8a0c-052027c4b18c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.771357] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c587345b-51c8-42f7-8a0c-052027c4b18c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.771581] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.771734] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.771829] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.772065] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.772195] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.772339] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c587345b-51c8-42f7-8a0c-052027c4b18c',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.274864] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.275092] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.275300] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.275571] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.275690] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.275917] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.276046] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.276113] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.276261] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.276335] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.276421] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c587345b-51c8-42f7-8a0c-052027c4b18c is going to be updated. [ 1226.306902] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.307107] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.307182] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.307409] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.307706] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.316258] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c587345b-51c8-42f7-8a0c-052027c4b18c in Status: IN_PROGRESS for 2s [ 1228.327623] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c587345b-51c8-42f7-8a0c-052027c4b18c in Status: SUCCESS [ 1228.327934] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c587345b-51c8-42f7-8a0c-052027c4b18c deletion is rescheduled due to dependency. [ 1228.327934] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c587345b-51c8-42f7-8a0c-052027c4b18c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.771639] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1230.771909] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1235.772631] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1235.773068] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1240.774181] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1240.774518] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1243.354168] env[65065]: INFO networking_nsxv3.common.synchronization [req-203b8cf8-58b3-4be7-8ff3-0c52b34e65b0 req-e6d72c91-c172-4362-9c5f-f7abdc24ed71 tempest-ServerActionsTestOtherA-78922671 tempest-ServerActionsTestOtherA-78922671-project-member] Enqueued Resource ID: 6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e with Priority: HIGHEST for action security_group_members [ 1243.355113] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e with Priority: HIGHEST for action security_group_members [ 1243.355524] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.355677] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.355766] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.356015] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.356378] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.356601] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.356669] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.357101] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.357227] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.357614] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.717923] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock network-33 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.718331] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "network-33" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.718601] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "network-33" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.718947] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "network-33" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.719388] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.719764] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.719988] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.720319] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.720651] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.720932] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1243.721132] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1243.721440] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1243.721615] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1243.721769] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1243.722017] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1243.722801] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1243.746749] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1243.747067] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1243.747407] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1243.748013] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "network-33" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.748313] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock port-b2920ac9-8168-408b-ad00-abbf4484753b taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.748561] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "port-b2920ac9-8168-408b-ad00-abbf4484753b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.748729] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "port-b2920ac9-8168-408b-ad00-abbf4484753b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.749234] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "port-b2920ac9-8168-408b-ad00-abbf4484753b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.749493] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b2920ac9-8168-408b-ad00-abbf4484753b',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.861152] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.252704] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.252962] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.253081] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.253484] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.253677] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.253881] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Segment Port b2920ac9-8168-408b-ad00-abbf4484753b not found, creating... [ 1244.254214] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.254464] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.254613] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.254868] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.255046] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.255414] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.255588] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.255743] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.256046] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.256199] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.256338] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Resource: SegmentPort with ID: b2920ac9-8168-408b-ad00-abbf4484753b is going to be created. [ 1244.280501] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.280798] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.280970] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.281308] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.281669] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.282034] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "port-b2920ac9-8168-408b-ad00-abbf4484753b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.364151] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.870025] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.870025] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.870025] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.870025] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.870025] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.870025] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e is going to be updated. [ 1244.906217] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.906385] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.906433] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.906646] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.906796] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.917795] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e in Status: IN_PROGRESS for 2s [ 1244.999842] env[65065]: INFO networking_nsxv3.common.synchronization [req-203b8cf8-58b3-4be7-8ff3-0c52b34e65b0 req-d350903f-679f-4be5-bb36-e07588f53e75 service nova] Enqueued Resource ID: 6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e with Priority: HIGHEST for action security_group_rules [ 1245.000049] env[65065]: INFO networking_nsxv3.common.synchronization [req-203b8cf8-58b3-4be7-8ff3-0c52b34e65b0 req-d350903f-679f-4be5-bb36-e07588f53e75 service nova] Enqueued Resource ID: 6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e with Priority: HIGHEST for action security_group_members [ 1245.000209] env[65065]: INFO networking_nsxv3.common.synchronization [req-203b8cf8-58b3-4be7-8ff3-0c52b34e65b0 req-d350903f-679f-4be5-bb36-e07588f53e75 service nova] Enqueued Resource ID: b2920ac9-8168-408b-ad00-abbf4484753b with Priority: HIGHEST for action port [ 1245.001129] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e with Priority: HIGHEST for action security_group_rules [ 1245.001129] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e with Priority: HIGHEST for action security_group_members [ 1245.001450] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2920ac9-8168-408b-ad00-abbf4484753b with Priority: HIGHEST for action port [ 1245.001625] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.001750] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.001817] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.002035] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.002141] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.003597] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.003709] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.003971] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-b2920ac9-8168-408b-ad00-abbf4484753b taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.004093] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b2920ac9-8168-408b-ad00-abbf4484753b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.004156] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b2920ac9-8168-408b-ad00-abbf4484753b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.004394] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b2920ac9-8168-408b-ad00-abbf4484753b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.004498] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b2920ac9-8168-408b-ad00-abbf4484753b',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.091586] env[65065]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-5dc288ef-8933-4403-998f-272fe36b910d None None] NSXv3 Agent Agent loop - iteration:2 completed [ 1245.091703] env[65065]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-5dc288ef-8933-4403-998f-272fe36b910d None None] NSXv3 Agent Agent loop - iteration:3 started [ 1245.127036] env[65065]: INFO networking_nsxv3.common.synchronization [None req-4b12534c-bcae-4e3d-8864-c6f7308a92d3 tempest-ServerRescueNegativeTestJSON-1519189094 tempest-ServerRescueNegativeTestJSON-1519189094-project-member] Enqueued Resource ID: eb00c909-3649-4026-9f97-79b0f488a362 with Priority: HIGHEST for action security_group_rules [ 1245.127111] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb00c909-3649-4026-9f97-79b0f488a362 with Priority: HIGHEST for action security_group_rules [ 1245.127431] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eb00c909-3649-4026-9f97-79b0f488a362 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.127851] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eb00c909-3649-4026-9f97-79b0f488a362" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.127851] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eb00c909-3649-4026-9f97-79b0f488a362" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.127851] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eb00c909-3649-4026-9f97-79b0f488a362" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.128052] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eb00c909-3649-4026-9f97-79b0f488a362',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.201352] env[65065]: INFO networking_nsxv3.common.synchronization [None req-4df820c8-b485-4e7a-a7c1-098ee3bcacc2 tempest-ServerRescueNegativeTestJSON-1519189094 tempest-ServerRescueNegativeTestJSON-1519189094-project-member] Enqueued Resource ID: eb00c909-3649-4026-9f97-79b0f488a362 with Priority: HIGHEST for action security_group_rules [ 1245.201352] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb00c909-3649-4026-9f97-79b0f488a362 with Priority: HIGHEST for action security_group_rules [ 1245.201352] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eb00c909-3649-4026-9f97-79b0f488a362 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.201352] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eb00c909-3649-4026-9f97-79b0f488a362" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.506738] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.507160] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.507160] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b2920ac9-8168-408b-ad00-abbf4484753b with status ACTIVE [ 1245.507341] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.507504] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.507572] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.507788] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.507904] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.508204] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.508275] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.508346] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.508549] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.508695] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.508860] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.508987] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.509096] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.509284] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.509397] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.509500] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b2920ac9-8168-408b-ad00-abbf4484753b is going to be updated. [ 1245.533785] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.533960] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.534075] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.534347] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.534536] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.534761] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b2920ac9-8168-408b-ad00-abbf4484753b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.655285] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.655465] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.655514] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.655812] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.655907] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.656012] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eb00c909-3649-4026-9f97-79b0f488a362 already deleted. [ 1245.656121] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eb00c909-3649-4026-9f97-79b0f488a362" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.656272] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eb00c909-3649-4026-9f97-79b0f488a362" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.656450] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eb00c909-3649-4026-9f97-79b0f488a362" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.656536] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eb00c909-3649-4026-9f97-79b0f488a362',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.177060] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.177224] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.177295] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.177503] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.177591] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.177686] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eb00c909-3649-4026-9f97-79b0f488a362 already deleted. [ 1246.177769] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eb00c909-3649-4026-9f97-79b0f488a362" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.927788] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e in Status: SUCCESS [ 1246.928114] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.928287] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.928593] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.928793] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.928932] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.928978] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.929152] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.929235] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.929330] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1247.431227] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1247.933751] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.439091] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.439250] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.439323] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.439544] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.439633] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.439733] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e is going to be updated. [ 1248.469658] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.469818] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.469862] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.470077] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.470218] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.482166] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e in Status: IN_PROGRESS for 2s [ 1250.200381] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1250.200672] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1250.494987] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e in Status: SUCCESS [ 1250.495232] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.495391] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.495606] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.495813] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.495922] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.495976] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.496241] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.496311] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.496393] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.496482] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.905982] env[65065]: INFO networking_nsxv3.common.synchronization [req-8010c1fe-acf0-41c2-b1ed-8cb55f9a5eeb req-9fe802ab-a3e4-41b3-afc5-a19389569f25 tempest-ServerRescueNegativeTestJSON-1519189094 tempest-ServerRescueNegativeTestJSON-1519189094-project-member] Enqueued Resource ID: eb00c909-3649-4026-9f97-79b0f488a362 with Priority: HIGHEST for action security_group_members [ 1250.906731] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb00c909-3649-4026-9f97-79b0f488a362 with Priority: HIGHEST for action security_group_members [ 1250.906906] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb00c909-3649-4026-9f97-79b0f488a362 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.907075] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb00c909-3649-4026-9f97-79b0f488a362" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.907159] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb00c909-3649-4026-9f97-79b0f488a362" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.907392] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb00c909-3649-4026-9f97-79b0f488a362" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.907561] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.907683] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.907765] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.907922] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.908020] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.908109] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eb00c909-3649-4026-9f97-79b0f488a362',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1251.000043] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1251.239579] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock network-987 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.239952] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "network-987" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.239952] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "network-987" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.240193] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "network-987" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.240639] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.240639] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.240811] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.241079] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.241245] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.241476] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1251.241590] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1251.241733] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1251.241818] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1251.241907] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1251.242056] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1251.242142] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1251.261347] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1251.261523] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1251.261723] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1251.262193] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "network-987" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.262280] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock port-27b194b9-9f17-45fe-8435-f46645efefdf taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.262434] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "port-27b194b9-9f17-45fe-8435-f46645efefdf" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.262532] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "port-27b194b9-9f17-45fe-8435-f46645efefdf" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.263307] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "port-27b194b9-9f17-45fe-8435-f46645efefdf" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.263307] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('27b194b9-9f17-45fe-8435-f46645efefdf',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1251.409827] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.409989] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.410062] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.410270] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.410357] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.410545] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.410642] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.410704] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.410845] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.410919] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.411008] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eb00c909-3649-4026-9f97-79b0f488a362 already deleted. [ 1251.411118] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb00c909-3649-4026-9f97-79b0f488a362" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.502182] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e: rpc.has_security_group_logging(os_id): False [ 1251.525073] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.525278] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.525331] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.525594] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.525693] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.525967] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.526080] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.526153] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.526312] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.527478] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.527478] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e is going to be updated. [ 1251.585398] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.585615] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.585615] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.586042] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.586219] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.598638] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e in Status: IN_PROGRESS for 2s [ 1251.767342] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.768208] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.768208] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.768558] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.768864] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.769012] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Segment Port 27b194b9-9f17-45fe-8435-f46645efefdf not found, creating... [ 1251.769385] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.769585] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.769766] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.769956] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.770103] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.770386] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.770544] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.770690] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.770908] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.771060] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.771198] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Resource: SegmentPort with ID: 27b194b9-9f17-45fe-8435-f46645efefdf is going to be created. [ 1251.791764] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.791972] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.792107] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.792369] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.792592] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.792807] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "port-27b194b9-9f17-45fe-8435-f46645efefdf" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.493622] env[65065]: INFO networking_nsxv3.common.synchronization [req-8010c1fe-acf0-41c2-b1ed-8cb55f9a5eeb req-912869a1-6be2-4135-9e64-ad4493d7c0c6 service nova] Enqueued Resource ID: eb00c909-3649-4026-9f97-79b0f488a362 with Priority: HIGHEST for action security_group_rules [ 1252.493904] env[65065]: INFO networking_nsxv3.common.synchronization [req-8010c1fe-acf0-41c2-b1ed-8cb55f9a5eeb req-912869a1-6be2-4135-9e64-ad4493d7c0c6 service nova] Enqueued Resource ID: eb00c909-3649-4026-9f97-79b0f488a362 with Priority: HIGHEST for action security_group_members [ 1252.496172] env[65065]: INFO networking_nsxv3.common.synchronization [req-8010c1fe-acf0-41c2-b1ed-8cb55f9a5eeb req-912869a1-6be2-4135-9e64-ad4493d7c0c6 service nova] Enqueued Resource ID: 27b194b9-9f17-45fe-8435-f46645efefdf with Priority: HIGHEST for action port [ 1252.496812] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb00c909-3649-4026-9f97-79b0f488a362 with Priority: HIGHEST for action security_group_rules [ 1252.497749] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb00c909-3649-4026-9f97-79b0f488a362 with Priority: HIGHEST for action security_group_members [ 1252.497749] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27b194b9-9f17-45fe-8435-f46645efefdf with Priority: HIGHEST for action port [ 1252.497749] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eb00c909-3649-4026-9f97-79b0f488a362 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.497749] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eb00c909-3649-4026-9f97-79b0f488a362" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.497749] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eb00c909-3649-4026-9f97-79b0f488a362" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.497749] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eb00c909-3649-4026-9f97-79b0f488a362" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.498013] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eb00c909-3649-4026-9f97-79b0f488a362',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.498823] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb00c909-3649-4026-9f97-79b0f488a362 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.498884] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb00c909-3649-4026-9f97-79b0f488a362" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.499278] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb00c909-3649-4026-9f97-79b0f488a362" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.499278] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb00c909-3649-4026-9f97-79b0f488a362" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.499278] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.499456] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.499456] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.499552] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.499626] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.499713] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eb00c909-3649-4026-9f97-79b0f488a362',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.500639] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-27b194b9-9f17-45fe-8435-f46645efefdf taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.500639] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-27b194b9-9f17-45fe-8435-f46645efefdf" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.500804] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-27b194b9-9f17-45fe-8435-f46645efefdf" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.500849] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-27b194b9-9f17-45fe-8435-f46645efefdf" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.500925] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('27b194b9-9f17-45fe-8435-f46645efefdf',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.002567] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eb00c909-3649-4026-9f97-79b0f488a362',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.003788] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb00c909-3649-4026-9f97-79b0f488a362 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.003916] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb00c909-3649-4026-9f97-79b0f488a362" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.004127] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 27b194b9-9f17-45fe-8435-f46645efefdf with status ACTIVE [ 1253.004518] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.004518] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.004518] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.004784] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.004880] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.005068] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.005167] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.005232] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.005439] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.005523] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.005702] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.005795] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.005858] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.006073] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.006175] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.006287] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 27b194b9-9f17-45fe-8435-f46645efefdf is going to be updated. [ 1253.029862] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.029862] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.029862] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.030251] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.030251] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.030357] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-27b194b9-9f17-45fe-8435-f46645efefdf" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.508275] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eb00c909-3649-4026-9f97-79b0f488a362',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.617051] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e in Status: SUCCESS [ 1253.617051] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.010963] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.011186] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.011268] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.011591] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.011699] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.011806] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eb00c909-3649-4026-9f97-79b0f488a362 is going to be created. [ 1254.035181] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.035375] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.035425] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.035602] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.035773] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.047067] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb00c909-3649-4026-9f97-79b0f488a362 in Status: UNINITIALIZED for 2s [ 1256.059064] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb00c909-3649-4026-9f97-79b0f488a362 in Status: SUCCESS [ 1256.059064] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb00c909-3649-4026-9f97-79b0f488a362" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.059336] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb00c909-3649-4026-9f97-79b0f488a362" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.059382] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb00c909-3649-4026-9f97-79b0f488a362" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.059562] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.059677] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.059733] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.059882] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.059959] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.060062] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb00c909-3649-4026-9f97-79b0f488a362" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.060452] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('eb00c909-3649-4026-9f97-79b0f488a362',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.562427] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('eb00c909-3649-4026-9f97-79b0f488a362',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.066451] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for eb00c909-3649-4026-9f97-79b0f488a362: rpc.has_security_group_logging(os_id): False [ 1257.085932] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.086109] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.086214] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.086538] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.086723] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.087029] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.087203] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.087305] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.087550] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.087683] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.087834] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eb00c909-3649-4026-9f97-79b0f488a362 is going to be created. [ 1257.158742] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.158742] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.158742] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.158987] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.159573] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.171508] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eb00c909-3649-4026-9f97-79b0f488a362 in Status: IN_PROGRESS for 2s [ 1257.395069] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock network-470 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.395285] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "network-470" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.395410] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "network-470" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.395679] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "network-470" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.395935] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.396102] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.396304] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.396559] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.396710] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.396917] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1257.397039] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1257.397171] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1257.397300] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1257.397414] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1257.397537] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1257.397699] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1257.418757] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1257.418934] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1257.419084] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1257.419264] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "network-470" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.419617] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock port-54f379b2-5dcf-45bb-b5e6-5d9ab3d9f558 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.419796] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "port-54f379b2-5dcf-45bb-b5e6-5d9ab3d9f558" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.419945] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "port-54f379b2-5dcf-45bb-b5e6-5d9ab3d9f558" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.420222] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "port-54f379b2-5dcf-45bb-b5e6-5d9ab3d9f558" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.420375] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('54f379b2-5dcf-45bb-b5e6-5d9ab3d9f558',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.498169] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1257.498350] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1257.923664] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.923929] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.924066] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.924352] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.924506] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.924831] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.924989] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.925128] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.925336] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.925472] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.925746] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.925923] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.926061] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.926260] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.926393] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.926532] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Resource: SegmentPort with ID: 54f379b2-5dcf-45bb-b5e6-5d9ab3d9f558 is going to be updated. [ 1257.947986] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.947986] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.947986] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.947986] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.948314] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.948314] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "port-54f379b2-5dcf-45bb-b5e6-5d9ab3d9f558" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.076453] env[65065]: INFO networking_nsxv3.common.synchronization [req-d2996c6d-19a8-4eea-b4f0-d629df5a9ffd req-5c797152-5afc-4152-a067-2cc376e528f8 service nova] Enqueued Resource ID: 4c1875d8-72c6-4298-b87e-1bda7f9214d3 with Priority: HIGHEST for action security_group_rules [ 1259.076754] env[65065]: INFO networking_nsxv3.common.synchronization [req-d2996c6d-19a8-4eea-b4f0-d629df5a9ffd req-5c797152-5afc-4152-a067-2cc376e528f8 service nova] Enqueued Resource ID: 4c1875d8-72c6-4298-b87e-1bda7f9214d3 with Priority: HIGHEST for action security_group_members [ 1259.076754] env[65065]: INFO networking_nsxv3.common.synchronization [req-d2996c6d-19a8-4eea-b4f0-d629df5a9ffd req-5c797152-5afc-4152-a067-2cc376e528f8 service nova] Enqueued Resource ID: 54f379b2-5dcf-45bb-b5e6-5d9ab3d9f558 with Priority: HIGHEST for action port [ 1259.077273] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c1875d8-72c6-4298-b87e-1bda7f9214d3 with Priority: HIGHEST for action security_group_rules [ 1259.077355] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c1875d8-72c6-4298-b87e-1bda7f9214d3 with Priority: HIGHEST for action security_group_members [ 1259.077445] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54f379b2-5dcf-45bb-b5e6-5d9ab3d9f558 with Priority: HIGHEST for action port [ 1259.077748] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4c1875d8-72c6-4298-b87e-1bda7f9214d3 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.077882] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4c1875d8-72c6-4298-b87e-1bda7f9214d3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.077951] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4c1875d8-72c6-4298-b87e-1bda7f9214d3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.078431] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4c1875d8-72c6-4298-b87e-1bda7f9214d3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.078431] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4c1875d8-72c6-4298-b87e-1bda7f9214d3',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.081669] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c1875d8-72c6-4298-b87e-1bda7f9214d3 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.081669] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c1875d8-72c6-4298-b87e-1bda7f9214d3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.081669] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c1875d8-72c6-4298-b87e-1bda7f9214d3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.081669] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c1875d8-72c6-4298-b87e-1bda7f9214d3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.081669] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.081669] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.081669] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.081669] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.081669] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.081669] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4c1875d8-72c6-4298-b87e-1bda7f9214d3',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.082474] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-54f379b2-5dcf-45bb-b5e6-5d9ab3d9f558 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.082474] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-54f379b2-5dcf-45bb-b5e6-5d9ab3d9f558" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.082474] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-54f379b2-5dcf-45bb-b5e6-5d9ab3d9f558" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.082474] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-54f379b2-5dcf-45bb-b5e6-5d9ab3d9f558" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.082474] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('54f379b2-5dcf-45bb-b5e6-5d9ab3d9f558',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.182869] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eb00c909-3649-4026-9f97-79b0f488a362 in Status: SUCCESS [ 1259.183208] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eb00c909-3649-4026-9f97-79b0f488a362" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.580827] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c1875d8-72c6-4298-b87e-1bda7f9214d3 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.582367] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c1875d8-72c6-4298-b87e-1bda7f9214d3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.584693] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4c1875d8-72c6-4298-b87e-1bda7f9214d3',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.585637] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 54f379b2-5dcf-45bb-b5e6-5d9ab3d9f558 with status ACTIVE [ 1259.585866] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.585993] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.586084] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.586312] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.586398] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.586582] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.586681] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.586755] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.586908] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.586983] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.587199] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.587292] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.587364] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.588528] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.588528] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.588528] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 54f379b2-5dcf-45bb-b5e6-5d9ab3d9f558 is going to be updated. [ 1259.610107] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.610327] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.610327] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.610510] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.610643] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.610804] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-54f379b2-5dcf-45bb-b5e6-5d9ab3d9f558" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.090912] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4c1875d8-72c6-4298-b87e-1bda7f9214d3',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1260.593566] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.593829] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.593909] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.594235] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.594394] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.594581] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c1875d8-72c6-4298-b87e-1bda7f9214d3 is going to be updated. [ 1260.627386] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.627633] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.627875] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.628225] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.628463] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.639166] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c1875d8-72c6-4298-b87e-1bda7f9214d3 in Status: IN_PROGRESS for 2s [ 1262.652545] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c1875d8-72c6-4298-b87e-1bda7f9214d3 in Status: SUCCESS [ 1262.652925] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c1875d8-72c6-4298-b87e-1bda7f9214d3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.652988] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c1875d8-72c6-4298-b87e-1bda7f9214d3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.653292] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c1875d8-72c6-4298-b87e-1bda7f9214d3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.653543] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.653669] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.653763] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.653954] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.654080] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.654193] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c1875d8-72c6-4298-b87e-1bda7f9214d3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.654305] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4c1875d8-72c6-4298-b87e-1bda7f9214d3',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1263.156578] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4c1875d8-72c6-4298-b87e-1bda7f9214d3',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1263.658808] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4c1875d8-72c6-4298-b87e-1bda7f9214d3: rpc.has_security_group_logging(os_id): False [ 1263.676345] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.676490] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.676559] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.676766] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.676858] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.677105] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.677205] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.677295] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.677502] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.677603] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.677697] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4c1875d8-72c6-4298-b87e-1bda7f9214d3 is going to be updated. [ 1263.745093] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.745307] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.745307] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.745511] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.745650] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.766190] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4c1875d8-72c6-4298-b87e-1bda7f9214d3 in Status: IN_PROGRESS for 2s [ 1264.078384] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1264.078586] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1265.783021] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4c1875d8-72c6-4298-b87e-1bda7f9214d3 in Status: SUCCESS [ 1265.783406] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4c1875d8-72c6-4298-b87e-1bda7f9214d3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.079612] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1269.080029] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1274.081141] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1274.081493] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1276.574604] env[65065]: INFO networking_nsxv3.common.synchronization [req-7a955684-94fe-4424-83fa-8490ef409ae3 req-b918351d-9330-4ce3-8bb5-96111c4c1a8e tempest-ServersV294TestFqdnHostnames-1358533709 tempest-ServersV294TestFqdnHostnames-1358533709-project-member] Enqueued Resource ID: 97377310-5980-4d43-8124-617efecbd7fb with Priority: HIGHEST for action security_group_members [ 1276.575534] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97377310-5980-4d43-8124-617efecbd7fb with Priority: HIGHEST for action security_group_members [ 1276.575534] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-97377310-5980-4d43-8124-617efecbd7fb taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.575534] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-97377310-5980-4d43-8124-617efecbd7fb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.575534] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-97377310-5980-4d43-8124-617efecbd7fb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.576268] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-97377310-5980-4d43-8124-617efecbd7fb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.576268] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.576268] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.576268] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.576457] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.576457] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.576511] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('97377310-5980-4d43-8124-617efecbd7fb',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1277.003195] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.003442] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.003442] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.003932] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.003932] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1277.078208] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.078411] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.078411] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.078612] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.078704] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.078898] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.078992] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.079101] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.079217] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.079291] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.079376] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 97377310-5980-4d43-8124-617efecbd7fb is going to be updated. [ 1277.107453] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.107671] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.107671] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.107860] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.108040] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.116204] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 97377310-5980-4d43-8124-617efecbd7fb in Status: IN_PROGRESS for 2s [ 1277.505884] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.008097] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.511541] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1278.511784] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1279.131754] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 97377310-5980-4d43-8124-617efecbd7fb in Status: SUCCESS [ 1279.132064] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 97377310-5980-4d43-8124-617efecbd7fb deletion is rescheduled due to dependency. [ 1279.132064] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-97377310-5980-4d43-8124-617efecbd7fb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.305567] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.305816] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.305816] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.306027] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.318419] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1279.319295] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.320447] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1279.365502] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.365689] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.365747] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.365916] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.378576] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.379407] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1279.379490] env[65065]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65065) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1279.379578] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1279.427897] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.428089] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.428089] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.428471] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.429374] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.429557] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1279.513579] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.513866] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.513866] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.514077] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.514427] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.514743] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1279.600767] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.600995] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.600995] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.601137] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.601407] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.601684] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:35. [ 1279.601779] env[65065]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e', 'b95b4f27-41f6-4a01-a1aa-aa16348ad807', '54addcf5-1b30-4561-a83f-43a8cf610f46', 'c587345b-51c8-42f7-8a0c-052027c4b18c', 'a057519d-085e-4b14-acb1-755fbec909af', 'eb00c909-3649-4026-9f97-79b0f488a362', 'cce60a92-c34e-445e-97a5-b8cfceb8b2b3', '8356bfa0-0d42-40e4-bec9-fd902715779f', '74c38cdd-0fc2-4b37-a5aa-b743e142dc55', '97377310-5980-4d43-8124-617efecbd7fb', 'f3805be6-3069-4624-897e-f4bf1dc6cd31', '9ed22036-e9a4-4639-89b9-c743ca686b09', 'c264aab4-0245-4fdf-8152-a3476b7dd553', '42051b03-8b5b-4d44-b3bc-8b87353afdd7', 'a7006bfc-4bfa-49da-a51e-6cc26b8098c3', 'd0abfe3e-a5d3-4a8d-bdc5-c03daff4976f', '9576b45f-b344-47bd-8f8b-9df4c3725ddb', '37c3f83a-5710-4c20-abeb-08e60639bed8', '4c1875d8-72c6-4298-b87e-1bda7f9214d3', 'adad9983-8e2e-4bac-8155-8a076b03abc3', '7d0941d4-57d8-45e9-9f2f-95128b8136e5', 'cc04914d-716e-49e1-8a77-946f904f69bb', '36b0a7bf-c185-47f8-9c6c-88ed66cc1f56', '5501386c-6d40-4911-b095-561660dd038b', '1e5f0086-b1e3-4f00-8207-8306f153d0e4', '6c6d05e2-e80c-477f-9eea-12f17d58d439', 'afe348a4-4bdc-4830-8b52-3584e5dee837', '386d96b4-ccad-4c04-8bda-534b3f25dc91', 'e2e5973c-5504-4cd5-9f92-77ba0193d841', 'e4ff6072-a232-4ebe-b049-2085dcef5991', '4a714159-17dd-4324-93b8-81c81e256b0e', '99423afc-7fd3-4e3d-8a84-f190e0af048f', '1a8690bf-b436-47bf-abed-9ade6d6d5c3f', '4473193a-198b-4342-a9ef-a1966ddd9441', '1b329aa6-2b06-4112-ad10-7c2ede9e4774'} {{(pid=65065) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1279.601866] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1279.621730] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.621960] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.621960] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.622157] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.622243] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.622349] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1279.622420] env[65065]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65065) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1279.622511] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1279.695013] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.695157] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.695236] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.695443] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.696657] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.696917] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1279.697008] env[65065]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65065) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1279.697136] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1279.697253] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1279.697386] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/35 resources of Type:Security Group Rules [ 1279.697524] env[65065]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e with Priority: HIGH for action security_group_rules [ 1279.697668] env[65065]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b95b4f27-41f6-4a01-a1aa-aa16348ad807 with Priority: HIGH for action security_group_rules [ 1279.697792] env[65065]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 54addcf5-1b30-4561-a83f-43a8cf610f46 with Priority: HIGH for action security_group_rules [ 1279.697916] env[65065]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c587345b-51c8-42f7-8a0c-052027c4b18c with Priority: HIGH for action security_group_rules [ 1279.698054] env[65065]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a057519d-085e-4b14-acb1-755fbec909af with Priority: HIGH for action security_group_rules [ 1279.698178] env[65065]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: eb00c909-3649-4026-9f97-79b0f488a362 with Priority: HIGH for action security_group_rules [ 1279.698295] env[65065]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cce60a92-c34e-445e-97a5-b8cfceb8b2b3 with Priority: HIGH for action security_group_rules [ 1279.698415] env[65065]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8356bfa0-0d42-40e4-bec9-fd902715779f with Priority: HIGH for action security_group_rules [ 1279.698528] env[65065]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 74c38cdd-0fc2-4b37-a5aa-b743e142dc55 with Priority: HIGH for action security_group_rules [ 1279.698639] env[65065]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 97377310-5980-4d43-8124-617efecbd7fb with Priority: HIGH for action security_group_rules [ 1279.698746] env[65065]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f3805be6-3069-4624-897e-f4bf1dc6cd31 with Priority: HIGH for action security_group_rules [ 1279.698862] env[65065]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9ed22036-e9a4-4639-89b9-c743ca686b09 with Priority: HIGH for action security_group_rules [ 1279.698954] env[65065]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c264aab4-0245-4fdf-8152-a3476b7dd553 with Priority: HIGH for action security_group_rules [ 1279.699078] env[65065]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 42051b03-8b5b-4d44-b3bc-8b87353afdd7 with Priority: HIGH for action security_group_rules [ 1279.699188] env[65065]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a7006bfc-4bfa-49da-a51e-6cc26b8098c3 with Priority: HIGH for action security_group_rules [ 1279.699296] env[65065]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d0abfe3e-a5d3-4a8d-bdc5-c03daff4976f with Priority: HIGH for action security_group_rules [ 1279.699403] env[65065]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9576b45f-b344-47bd-8f8b-9df4c3725ddb with Priority: HIGH for action security_group_rules [ 1279.699506] env[65065]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 37c3f83a-5710-4c20-abeb-08e60639bed8 with Priority: HIGH for action security_group_rules [ 1279.699618] env[65065]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4c1875d8-72c6-4298-b87e-1bda7f9214d3 with Priority: HIGH for action security_group_rules [ 1279.699736] env[65065]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: adad9983-8e2e-4bac-8155-8a076b03abc3 with Priority: HIGH for action security_group_rules [ 1279.699889] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.576476] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1281.576772] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=0 [ 1281.576772] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e with Priority: HIGH for action security_group_rules [ 1281.576841] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54addcf5-1b30-4561-a83f-43a8cf610f46 with Priority: HIGH for action security_group_rules [ 1281.576923] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cce60a92-c34e-445e-97a5-b8cfceb8b2b3 with Priority: HIGH for action security_group_rules [ 1281.576977] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7006bfc-4bfa-49da-a51e-6cc26b8098c3 with Priority: HIGH for action security_group_rules [ 1281.577088] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adad9983-8e2e-4bac-8155-8a076b03abc3 with Priority: HIGH for action security_group_rules [ 1281.579265] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c1875d8-72c6-4298-b87e-1bda7f9214d3 with Priority: HIGH for action security_group_rules [ 1281.579381] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37c3f83a-5710-4c20-abeb-08e60639bed8 with Priority: HIGH for action security_group_rules [ 1281.579419] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9576b45f-b344-47bd-8f8b-9df4c3725ddb with Priority: HIGH for action security_group_rules [ 1281.579505] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42051b03-8b5b-4d44-b3bc-8b87353afdd7 with Priority: HIGH for action security_group_rules [ 1281.579645] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0abfe3e-a5d3-4a8d-bdc5-c03daff4976f with Priority: HIGH for action security_group_rules [ 1281.579756] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c264aab4-0245-4fdf-8152-a3476b7dd553 with Priority: HIGH for action security_group_rules [ 1281.579809] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ed22036-e9a4-4639-89b9-c743ca686b09 with Priority: HIGH for action security_group_rules [ 1281.579842] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3805be6-3069-4624-897e-f4bf1dc6cd31 with Priority: HIGH for action security_group_rules [ 1281.580063] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97377310-5980-4d43-8124-617efecbd7fb with Priority: HIGH for action security_group_rules [ 1281.580063] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74c38cdd-0fc2-4b37-a5aa-b743e142dc55 with Priority: HIGH for action security_group_rules [ 1281.580210] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb00c909-3649-4026-9f97-79b0f488a362 with Priority: HIGH for action security_group_rules [ 1281.580210] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8356bfa0-0d42-40e4-bec9-fd902715779f with Priority: HIGH for action security_group_rules [ 1281.580303] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a057519d-085e-4b14-acb1-755fbec909af with Priority: HIGH for action security_group_rules [ 1281.580347] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b95b4f27-41f6-4a01-a1aa-aa16348ad807 with Priority: HIGH for action security_group_rules [ 1281.580407] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c587345b-51c8-42f7-8a0c-052027c4b18c with Priority: HIGH for action security_group_rules [ 1281.580765] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.580925] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.580995] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.581216] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.581295] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.582351] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-54addcf5-1b30-4561-a83f-43a8cf610f46 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.582585] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-54addcf5-1b30-4561-a83f-43a8cf610f46" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.582585] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-54addcf5-1b30-4561-a83f-43a8cf610f46" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.582703] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-54addcf5-1b30-4561-a83f-43a8cf610f46" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.582762] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('54addcf5-1b30-4561-a83f-43a8cf610f46',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.583632] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cce60a92-c34e-445e-97a5-b8cfceb8b2b3 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.583838] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cce60a92-c34e-445e-97a5-b8cfceb8b2b3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.583929] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cce60a92-c34e-445e-97a5-b8cfceb8b2b3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.584073] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cce60a92-c34e-445e-97a5-b8cfceb8b2b3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.584171] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cce60a92-c34e-445e-97a5-b8cfceb8b2b3',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.584897] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a7006bfc-4bfa-49da-a51e-6cc26b8098c3 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.585029] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a7006bfc-4bfa-49da-a51e-6cc26b8098c3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.585082] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a7006bfc-4bfa-49da-a51e-6cc26b8098c3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.585216] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a7006bfc-4bfa-49da-a51e-6cc26b8098c3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.585289] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a7006bfc-4bfa-49da-a51e-6cc26b8098c3',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.586130] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-adad9983-8e2e-4bac-8155-8a076b03abc3 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.586260] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-adad9983-8e2e-4bac-8155-8a076b03abc3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.586530] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-adad9983-8e2e-4bac-8155-8a076b03abc3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.586530] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-adad9983-8e2e-4bac-8155-8a076b03abc3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.586530] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('adad9983-8e2e-4bac-8155-8a076b03abc3',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.587202] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4c1875d8-72c6-4298-b87e-1bda7f9214d3 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.587329] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4c1875d8-72c6-4298-b87e-1bda7f9214d3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.587397] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4c1875d8-72c6-4298-b87e-1bda7f9214d3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.587564] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4c1875d8-72c6-4298-b87e-1bda7f9214d3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.587564] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4c1875d8-72c6-4298-b87e-1bda7f9214d3',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.588305] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-37c3f83a-5710-4c20-abeb-08e60639bed8 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.588417] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-37c3f83a-5710-4c20-abeb-08e60639bed8" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.588417] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-37c3f83a-5710-4c20-abeb-08e60639bed8" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.588538] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-37c3f83a-5710-4c20-abeb-08e60639bed8" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.588611] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('37c3f83a-5710-4c20-abeb-08e60639bed8',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.589278] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9576b45f-b344-47bd-8f8b-9df4c3725ddb taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.589379] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9576b45f-b344-47bd-8f8b-9df4c3725ddb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.591727] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9576b45f-b344-47bd-8f8b-9df4c3725ddb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.591727] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9576b45f-b344-47bd-8f8b-9df4c3725ddb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.591727] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9576b45f-b344-47bd-8f8b-9df4c3725ddb',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.591727] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-42051b03-8b5b-4d44-b3bc-8b87353afdd7 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.591727] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-42051b03-8b5b-4d44-b3bc-8b87353afdd7" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.591727] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-42051b03-8b5b-4d44-b3bc-8b87353afdd7" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.591727] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-42051b03-8b5b-4d44-b3bc-8b87353afdd7" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.591727] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('42051b03-8b5b-4d44-b3bc-8b87353afdd7',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.591727] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d0abfe3e-a5d3-4a8d-bdc5-c03daff4976f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.591727] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d0abfe3e-a5d3-4a8d-bdc5-c03daff4976f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.591727] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d0abfe3e-a5d3-4a8d-bdc5-c03daff4976f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.591727] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d0abfe3e-a5d3-4a8d-bdc5-c03daff4976f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.592246] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d0abfe3e-a5d3-4a8d-bdc5-c03daff4976f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.592538] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c264aab4-0245-4fdf-8152-a3476b7dd553 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.592538] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c264aab4-0245-4fdf-8152-a3476b7dd553" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.593412] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c264aab4-0245-4fdf-8152-a3476b7dd553" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.593412] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c264aab4-0245-4fdf-8152-a3476b7dd553" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.593412] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c264aab4-0245-4fdf-8152-a3476b7dd553',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.593624] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9ed22036-e9a4-4639-89b9-c743ca686b09 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.593684] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9ed22036-e9a4-4639-89b9-c743ca686b09" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.593779] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9ed22036-e9a4-4639-89b9-c743ca686b09" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.594337] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9ed22036-e9a4-4639-89b9-c743ca686b09" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.594337] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9ed22036-e9a4-4639-89b9-c743ca686b09',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.595186] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f3805be6-3069-4624-897e-f4bf1dc6cd31 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.595186] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f3805be6-3069-4624-897e-f4bf1dc6cd31" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.595186] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f3805be6-3069-4624-897e-f4bf1dc6cd31" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.595186] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f3805be6-3069-4624-897e-f4bf1dc6cd31" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.595186] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f3805be6-3069-4624-897e-f4bf1dc6cd31',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.595902] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-97377310-5980-4d43-8124-617efecbd7fb taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.595902] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-97377310-5980-4d43-8124-617efecbd7fb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.595902] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-97377310-5980-4d43-8124-617efecbd7fb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.595902] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-97377310-5980-4d43-8124-617efecbd7fb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.596230] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('97377310-5980-4d43-8124-617efecbd7fb',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.596643] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-74c38cdd-0fc2-4b37-a5aa-b743e142dc55 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.596775] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-74c38cdd-0fc2-4b37-a5aa-b743e142dc55" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.596824] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-74c38cdd-0fc2-4b37-a5aa-b743e142dc55" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.596966] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-74c38cdd-0fc2-4b37-a5aa-b743e142dc55" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.597061] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('74c38cdd-0fc2-4b37-a5aa-b743e142dc55',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.599063] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eb00c909-3649-4026-9f97-79b0f488a362 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.599063] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eb00c909-3649-4026-9f97-79b0f488a362" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.599063] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eb00c909-3649-4026-9f97-79b0f488a362" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.599063] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eb00c909-3649-4026-9f97-79b0f488a362" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.599063] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eb00c909-3649-4026-9f97-79b0f488a362',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.599063] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8356bfa0-0d42-40e4-bec9-fd902715779f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.599063] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8356bfa0-0d42-40e4-bec9-fd902715779f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.599466] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8356bfa0-0d42-40e4-bec9-fd902715779f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.599466] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8356bfa0-0d42-40e4-bec9-fd902715779f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.599466] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8356bfa0-0d42-40e4-bec9-fd902715779f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.600189] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a057519d-085e-4b14-acb1-755fbec909af taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.600325] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a057519d-085e-4b14-acb1-755fbec909af" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.600417] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a057519d-085e-4b14-acb1-755fbec909af" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.600583] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a057519d-085e-4b14-acb1-755fbec909af" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.600751] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a057519d-085e-4b14-acb1-755fbec909af',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.601779] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b95b4f27-41f6-4a01-a1aa-aa16348ad807 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.601779] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b95b4f27-41f6-4a01-a1aa-aa16348ad807" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.601779] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b95b4f27-41f6-4a01-a1aa-aa16348ad807" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.601972] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b95b4f27-41f6-4a01-a1aa-aa16348ad807" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.601972] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b95b4f27-41f6-4a01-a1aa-aa16348ad807',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.602719] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c587345b-51c8-42f7-8a0c-052027c4b18c taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.602719] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c587345b-51c8-42f7-8a0c-052027c4b18c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.602842] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c587345b-51c8-42f7-8a0c-052027c4b18c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.603650] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c587345b-51c8-42f7-8a0c-052027c4b18c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.603650] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c587345b-51c8-42f7-8a0c-052027c4b18c',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.628137] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.628344] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.628396] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.628917] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.656207] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.656471] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 54addcf5-1b30-4561-a83f-43a8cf610f46 is going to be deleted. [ 1281.725499] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.725750] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.725750] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.725928] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.726037] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.726169] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-54addcf5-1b30-4561-a83f-43a8cf610f46" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.106056] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c1875d8-72c6-4298-b87e-1bda7f9214d3 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.106267] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c1875d8-72c6-4298-b87e-1bda7f9214d3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.106367] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c1875d8-72c6-4298-b87e-1bda7f9214d3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.106591] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c1875d8-72c6-4298-b87e-1bda7f9214d3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.106760] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.106917] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.107019] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.107172] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.107319] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.107469] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c1875d8-72c6-4298-b87e-1bda7f9214d3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.107585] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4c1875d8-72c6-4298-b87e-1bda7f9214d3',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1282.114655] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-a057519d-085e-4b14-acb1-755fbec909af taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.114916] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a057519d-085e-4b14-acb1-755fbec909af" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.114988] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a057519d-085e-4b14-acb1-755fbec909af" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.115235] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a057519d-085e-4b14-acb1-755fbec909af" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.115435] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.115855] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.115855] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.115855] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.116129] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.116129] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a057519d-085e-4b14-acb1-755fbec909af" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.116201] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a057519d-085e-4b14-acb1-755fbec909af',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1282.118557] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.118968] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.118968] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.118968] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.119137] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.119188] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.119252] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.119447] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.119482] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.119550] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.119635] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1282.125703] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb00c909-3649-4026-9f97-79b0f488a362 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.126600] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb00c909-3649-4026-9f97-79b0f488a362" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.126600] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb00c909-3649-4026-9f97-79b0f488a362" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.126600] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb00c909-3649-4026-9f97-79b0f488a362" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.126600] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.126815] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.126815] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.127249] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.127249] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.127249] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb00c909-3649-4026-9f97-79b0f488a362" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.127249] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('eb00c909-3649-4026-9f97-79b0f488a362',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1282.203446] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.203651] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.203705] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.204258] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.207087] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.207263] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.208481] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.208631] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.210108] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.210441] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.211968] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.212120] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.213314] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.213453] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.214531] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.214667] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.215645] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.215784] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.216828] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.216973] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.217988] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.218148] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.220262] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.220396] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.221316] env[65065]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1282.221870] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.222001] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.222848] env[65065]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1282.223441] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.223583] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.224943] env[65065]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1282.225636] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.225785] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.226658] env[65065]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1282.227240] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.227383] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.253069] env[65065]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1282.253626] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.253940] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: adad9983-8e2e-4bac-8155-8a076b03abc3 is going to be deleted. [ 1282.255319] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.255768] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.292032] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.292207] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 42051b03-8b5b-4d44-b3bc-8b87353afdd7 is going to be deleted. [ 1282.293191] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.293421] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.475365] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.475365] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.484156] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.484156] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8356bfa0-0d42-40e4-bec9-fd902715779f is going to be deleted. [ 1282.485156] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.485467] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.511777] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.512069] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 74c38cdd-0fc2-4b37-a5aa-b743e142dc55 is going to be deleted. [ 1282.513089] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.513408] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.539187] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.539382] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c264aab4-0245-4fdf-8152-a3476b7dd553 is going to be deleted. [ 1282.540423] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.540683] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.558076] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.558076] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.593132] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.593527] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.613602] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4c1875d8-72c6-4298-b87e-1bda7f9214d3',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1282.621198] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.621368] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a7006bfc-4bfa-49da-a51e-6cc26b8098c3 is going to be deleted. [ 1282.622468] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.622711] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.634075] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-a057519d-085e-4b14-acb1-755fbec909af taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.634297] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a057519d-085e-4b14-acb1-755fbec909af" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.634379] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a057519d-085e-4b14-acb1-755fbec909af" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.634664] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a057519d-085e-4b14-acb1-755fbec909af" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.634884] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.635064] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.635064] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.635623] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.635623] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.635623] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a057519d-085e-4b14-acb1-755fbec909af" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.635795] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-a057519d-085e-4b14-acb1-755fbec909af taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.635795] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a057519d-085e-4b14-acb1-755fbec909af" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.635795] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a057519d-085e-4b14-acb1-755fbec909af" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.636010] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a057519d-085e-4b14-acb1-755fbec909af" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.636747] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.636879] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.637451] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.637451] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.637451] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.637451] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a057519d-085e-4b14-acb1-755fbec909af" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.637451] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a057519d-085e-4b14-acb1-755fbec909af',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1282.640233] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1282.642118] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('eb00c909-3649-4026-9f97-79b0f488a362',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1282.658228] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.658228] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.709305] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.709536] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 97377310-5980-4d43-8124-617efecbd7fb is going to be deleted. [ 1282.710565] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.710797] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.772761] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.772981] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.797695] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.797901] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cce60a92-c34e-445e-97a5-b8cfceb8b2b3 is going to be deleted. [ 1282.798831] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.799188] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.833313] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.833513] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.916908] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.917116] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9ed22036-e9a4-4639-89b9-c743ca686b09 is going to be deleted. [ 1282.918544] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.918800] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.983261] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.983443] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d0abfe3e-a5d3-4a8d-bdc5-c03daff4976f is going to be deleted. [ 1282.984417] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.984646] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.075238] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.075430] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.088533] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.088719] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b95b4f27-41f6-4a01-a1aa-aa16348ad807 is going to be deleted. [ 1283.089732] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.090015] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.116441] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4c1875d8-72c6-4298-b87e-1bda7f9214d3: rpc.has_security_group_logging(os_id): False [ 1283.142451] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a057519d-085e-4b14-acb1-755fbec909af: rpc.has_security_group_logging(os_id): False [ 1283.144208] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e: rpc.has_security_group_logging(os_id): False [ 1283.145757] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for eb00c909-3649-4026-9f97-79b0f488a362: rpc.has_security_group_logging(os_id): False [ 1283.152587] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.152753] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.155465] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.155590] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.157102] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.157226] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.177261] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.177419] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 37c3f83a-5710-4c20-abeb-08e60639bed8 is going to be deleted. [ 1283.178377] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.178655] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.232151] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.232398] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.233288] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.233397] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.240030] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.240175] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.257071] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.257279] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.271965] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.272139] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c587345b-51c8-42f7-8a0c-052027c4b18c is going to be deleted. [ 1283.273054] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.273346] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.330273] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.330402] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.390708] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.390921] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9576b45f-b344-47bd-8f8b-9df4c3725ddb is going to be deleted. [ 1283.391754] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.392231] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.449414] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.449576] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f3805be6-3069-4624-897e-f4bf1dc6cd31 is going to be deleted. [ 1283.450486] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.450703] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.450797] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.450925] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-adad9983-8e2e-4bac-8155-8a076b03abc3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.451104] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.451270] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.451349] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.451460] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-42051b03-8b5b-4d44-b3bc-8b87353afdd7" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.452271] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.452481] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.452573] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.452701] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8356bfa0-0d42-40e4-bec9-fd902715779f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.452846] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.453018] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.453094] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.453214] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-74c38cdd-0fc2-4b37-a5aa-b743e142dc55" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.453345] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.453489] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.453637] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.453693] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c264aab4-0245-4fdf-8152-a3476b7dd553" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.453828] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.453964] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.454053] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.454170] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a7006bfc-4bfa-49da-a51e-6cc26b8098c3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.454301] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.454444] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.454518] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.454633] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-97377310-5980-4d43-8124-617efecbd7fb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.454776] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.454947] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.455039] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.455156] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cce60a92-c34e-445e-97a5-b8cfceb8b2b3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.455285] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.455423] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.455500] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.455607] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9ed22036-e9a4-4639-89b9-c743ca686b09" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.455733] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.455870] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.468653] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.468895] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.492372] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.492571] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.496500] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.496810] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.496912] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.496977] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.497207] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.497423] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.497529] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4c1875d8-72c6-4298-b87e-1bda7f9214d3 is going to be updated. [ 1283.498633] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.498833] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.558385] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.558721] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.558843] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.558894] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.559159] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.559194] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.559282] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eb00c909-3649-4026-9f97-79b0f488a362 is going to be updated. [ 1283.561789] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.561789] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.561789] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.561789] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.561789] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.561789] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9576b45f-b344-47bd-8f8b-9df4c3725ddb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.562125] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.562125] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.562194] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.562308] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d0abfe3e-a5d3-4a8d-bdc5-c03daff4976f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.562421] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.562559] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.625492] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.625857] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.625961] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.626033] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.626352] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.626352] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.626432] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e is going to be updated. [ 1283.627559] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.627737] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.627824] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.627946] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c587345b-51c8-42f7-8a0c-052027c4b18c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.628095] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.628270] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.642710] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.643039] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.689463] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.689598] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.749279] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.749578] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.749698] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.750365] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.750365] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.750365] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.750365] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.750365] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.750580] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.750580] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.750580] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.750847] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.750847] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.750847] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.751200] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.751200] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.751286] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a057519d-085e-4b14-acb1-755fbec909af is going to be updated. [ 1283.752356] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.752558] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.752558] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.752769] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-37c3f83a-5710-4c20-abeb-08e60639bed8" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.752817] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.753113] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.753113] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.753216] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b95b4f27-41f6-4a01-a1aa-aa16348ad807" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.753275] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.753417] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.753591] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.753641] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f3805be6-3069-4624-897e-f4bf1dc6cd31" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.753744] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.753980] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.754131] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.794632] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.794879] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.795018] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.795284] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.795487] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.899046] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eb00c909-3649-4026-9f97-79b0f488a362 in Status: IN_PROGRESS for 2s [ 1283.903489] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4c1875d8-72c6-4298-b87e-1bda7f9214d3 in Status: IN_PROGRESS for 2s [ 1283.909623] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.909827] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.909827] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.910064] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.910215] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.948485] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e in Status: IN_PROGRESS for 2s [ 1283.949763] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.949914] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.949988] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.950251] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.950440] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.005893] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a057519d-085e-4b14-acb1-755fbec909af in Status: IN_PROGRESS for 2s [ 1285.918042] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eb00c909-3649-4026-9f97-79b0f488a362 in Status: SUCCESS [ 1285.918431] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eb00c909-3649-4026-9f97-79b0f488a362" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.919052] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4c1875d8-72c6-4298-b87e-1bda7f9214d3 in Status: SUCCESS [ 1285.919248] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4c1875d8-72c6-4298-b87e-1bda7f9214d3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.962985] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e in Status: SUCCESS [ 1285.963215] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.022414] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a057519d-085e-4b14-acb1-755fbec909af in Status: SUCCESS [ 1286.022667] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a057519d-085e-4b14-acb1-755fbec909af" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.581238] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1286.581419] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1291.582768] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1291.583189] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1296.584462] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1296.584883] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1301.585802] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1301.586227] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1306.587566] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1306.587566] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1311.588199] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1311.588199] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1311.925124] env[65065]: INFO networking_nsxv3.common.synchronization [req-fd92f22d-b260-4153-ae8c-ab06e17b1dbd req-96a787cc-49ea-4341-a46b-34eb50cd9d29 tempest-AttachVolumeShelveTestJSON-217038498 tempest-AttachVolumeShelveTestJSON-217038498-project-member] Enqueued Resource ID: 4c1875d8-72c6-4298-b87e-1bda7f9214d3 with Priority: HIGHEST for action security_group_members [ 1311.925710] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c1875d8-72c6-4298-b87e-1bda7f9214d3 with Priority: HIGHEST for action security_group_members [ 1311.926145] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c1875d8-72c6-4298-b87e-1bda7f9214d3 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.926480] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c1875d8-72c6-4298-b87e-1bda7f9214d3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.926480] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c1875d8-72c6-4298-b87e-1bda7f9214d3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.926596] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c1875d8-72c6-4298-b87e-1bda7f9214d3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.926702] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.927077] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.927077] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.927077] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.927255] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.927255] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4c1875d8-72c6-4298-b87e-1bda7f9214d3',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1312.429916] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.430146] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.430195] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.430394] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.430486] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.431223] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.431223] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.431223] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.431223] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.431223] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.431223] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c1875d8-72c6-4298-b87e-1bda7f9214d3 is going to be updated. [ 1312.487304] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.487491] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.487604] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.487848] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.488032] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.503745] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c1875d8-72c6-4298-b87e-1bda7f9214d3 in Status: IN_PROGRESS for 2s [ 1314.515455] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c1875d8-72c6-4298-b87e-1bda7f9214d3 in Status: SUCCESS [ 1314.515874] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c1875d8-72c6-4298-b87e-1bda7f9214d3 deletion is rescheduled due to dependency. [ 1314.515874] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c1875d8-72c6-4298-b87e-1bda7f9214d3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.993226] env[65065]: INFO networking_nsxv3.common.synchronization [req-04333b2a-3cb6-4e54-91f3-e3aa920eede9 req-7533c69a-7eed-4d82-a35b-aec5ec45f312 tempest-ServerActionsTestOtherA-78922671 tempest-ServerActionsTestOtherA-78922671-project-member] Enqueued Resource ID: 6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e with Priority: HIGHEST for action security_group_members [ 1314.993787] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e with Priority: HIGHEST for action security_group_members [ 1314.994139] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.994270] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.994315] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.994506] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.994653] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.994746] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.994807] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.994950] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.995055] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.995221] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1315.497449] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1316.000390] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1316.503360] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.503550] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.503550] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.504389] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.504389] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.504389] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e is going to be updated. [ 1316.535495] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.535741] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.537038] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.537038] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.537038] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.546233] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e in Status: IN_PROGRESS for 2s [ 1318.557842] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e in Status: SUCCESS [ 1318.558234] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.995226] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1319.995226] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1324.193943] env[65065]: INFO networking_nsxv3.common.synchronization [None req-69ad2e95-cbda-4970-8b44-fda8cd08a17d None None] Enqueued Resource ID: 674c0f01-8f41-4172-91d9-959143a83cb0 with Priority: HIGHEST for action port [ 1324.194539] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 674c0f01-8f41-4172-91d9-959143a83cb0 with Priority: HIGHEST for action port [ 1324.194923] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-674c0f01-8f41-4172-91d9-959143a83cb0 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.195044] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-674c0f01-8f41-4172-91d9-959143a83cb0" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.195087] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-674c0f01-8f41-4172-91d9-959143a83cb0" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.195385] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-674c0f01-8f41-4172-91d9-959143a83cb0" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.195474] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('674c0f01-8f41-4172-91d9-959143a83cb0',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1324.381172] env[65065]: INFO networking_nsxv3.common.synchronization [None req-3ffa07a4-221e-45d9-a5fd-c58f282e8f6c tempest-AttachVolumeTestJSON-207450638 tempest-AttachVolumeTestJSON-207450638-project-member] Enqueued Resource ID: 3197cfcc-1b3e-4ef1-a343-d5e39684c0d2 with Priority: HIGHEST for action security_group_rules [ 1324.381700] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3197cfcc-1b3e-4ef1-a343-d5e39684c0d2 with Priority: HIGHEST for action security_group_rules [ 1324.381990] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3197cfcc-1b3e-4ef1-a343-d5e39684c0d2 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.382135] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3197cfcc-1b3e-4ef1-a343-d5e39684c0d2" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.382210] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3197cfcc-1b3e-4ef1-a343-d5e39684c0d2" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.382459] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3197cfcc-1b3e-4ef1-a343-d5e39684c0d2" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.382544] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3197cfcc-1b3e-4ef1-a343-d5e39684c0d2',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1324.467507] env[65065]: INFO networking_nsxv3.common.synchronization [None req-204eb9c6-3f52-4e27-8244-5acfd1456bcf tempest-AttachVolumeTestJSON-207450638 tempest-AttachVolumeTestJSON-207450638-project-member] Enqueued Resource ID: 3197cfcc-1b3e-4ef1-a343-d5e39684c0d2 with Priority: HIGHEST for action security_group_rules [ 1324.468137] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3197cfcc-1b3e-4ef1-a343-d5e39684c0d2 with Priority: HIGHEST for action security_group_rules [ 1324.468137] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3197cfcc-1b3e-4ef1-a343-d5e39684c0d2 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.468137] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3197cfcc-1b3e-4ef1-a343-d5e39684c0d2" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.698538] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 674c0f01-8f41-4172-91d9-959143a83cb0 [ 1324.698684] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.698825] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.698886] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.699105] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.699199] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.699296] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:674c0f01-8f41-4172-91d9-959143a83cb0 already deleted. [ 1324.699382] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-674c0f01-8f41-4172-91d9-959143a83cb0" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.905842] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.905999] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.906130] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.906337] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.906376] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.906436] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3197cfcc-1b3e-4ef1-a343-d5e39684c0d2 already deleted. [ 1324.906621] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3197cfcc-1b3e-4ef1-a343-d5e39684c0d2" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.906668] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3197cfcc-1b3e-4ef1-a343-d5e39684c0d2" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.906825] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3197cfcc-1b3e-4ef1-a343-d5e39684c0d2" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.906906] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3197cfcc-1b3e-4ef1-a343-d5e39684c0d2',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1325.430128] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.430449] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.430449] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.430449] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.430551] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.431107] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3197cfcc-1b3e-4ef1-a343-d5e39684c0d2 already deleted. [ 1325.431107] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3197cfcc-1b3e-4ef1-a343-d5e39684c0d2" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.401033] env[65065]: INFO networking_nsxv3.common.synchronization [None req-6d6c0597-6147-4fbd-88b8-19c463cf4e6e None None] Enqueued Resource ID: 167f80da-682c-448e-a1c7-ece72f1430c3 with Priority: HIGHEST for action port [ 1326.401738] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 167f80da-682c-448e-a1c7-ece72f1430c3 with Priority: HIGHEST for action port [ 1326.402229] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-167f80da-682c-448e-a1c7-ece72f1430c3 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.402440] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-167f80da-682c-448e-a1c7-ece72f1430c3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.402547] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-167f80da-682c-448e-a1c7-ece72f1430c3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.402887] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-167f80da-682c-448e-a1c7-ece72f1430c3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.402999] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('167f80da-682c-448e-a1c7-ece72f1430c3',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1326.905624] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 167f80da-682c-448e-a1c7-ece72f1430c3 [ 1326.905983] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.905983] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.906130] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.906253] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.906343] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.906440] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:167f80da-682c-448e-a1c7-ece72f1430c3 already deleted. [ 1326.906518] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-167f80da-682c-448e-a1c7-ece72f1430c3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.454948] env[65065]: INFO networking_nsxv3.common.synchronization [req-eac37153-7f42-4e55-824f-e24a2300668e req-0bd023de-8589-4d07-b16f-b15b86b66b87 tempest-ServerActionsTestOtherA-78922671 tempest-ServerActionsTestOtherA-78922671-project-member] Enqueued Resource ID: 6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e with Priority: HIGHEST for action security_group_members [ 1329.455546] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e with Priority: HIGHEST for action security_group_members [ 1329.455864] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.456016] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.456083] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.456256] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.456409] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.456515] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.456744] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.456744] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.456842] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.457852] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1329.939944] env[65065]: INFO networking_nsxv3.common.synchronization [req-7f3b9640-6fef-4cd6-8d9e-84bb2fc60540 req-b2da2e46-6a54-4456-b34a-955ca19e7b8f tempest-AttachVolumeTestJSON-207450638 tempest-AttachVolumeTestJSON-207450638-project-member] Enqueued Resource ID: 3197cfcc-1b3e-4ef1-a343-d5e39684c0d2 with Priority: HIGHEST for action security_group_members [ 1329.940475] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3197cfcc-1b3e-4ef1-a343-d5e39684c0d2 with Priority: HIGHEST for action security_group_members [ 1329.943330] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-3197cfcc-1b3e-4ef1-a343-d5e39684c0d2 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.943503] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3197cfcc-1b3e-4ef1-a343-d5e39684c0d2" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.943589] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3197cfcc-1b3e-4ef1-a343-d5e39684c0d2" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.943919] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3197cfcc-1b3e-4ef1-a343-d5e39684c0d2" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.944149] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.944310] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.944412] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.944600] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.944727] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.944858] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3197cfcc-1b3e-4ef1-a343-d5e39684c0d2',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1329.959691] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.959824] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.959893] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.960116] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.960208] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.960400] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.960496] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.960558] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.960699] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.960772] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.960854] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e is going to be updated. [ 1329.993526] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.993728] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.993728] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.993908] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.994055] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.002927] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e in Status: IN_PROGRESS for 2s [ 1330.225936] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock network-410 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.226150] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "network-410" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.226274] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "network-410" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.226620] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "network-410" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.226907] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.227084] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.227204] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.227447] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.227593] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.227801] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1330.227914] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1330.228038] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1330.228151] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1330.228264] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1330.228370] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1330.228503] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1330.249114] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1330.249300] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1330.249491] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1330.249668] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "network-410" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.249989] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock port-42af6d2e-4c87-4459-9977-cb5c4109763c taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.250174] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "port-42af6d2e-4c87-4459-9977-cb5c4109763c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.250291] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "port-42af6d2e-4c87-4459-9977-cb5c4109763c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.250614] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "port-42af6d2e-4c87-4459-9977-cb5c4109763c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.250779] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('42af6d2e-4c87-4459-9977-cb5c4109763c',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1330.447255] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.447430] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.447477] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.447814] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.447814] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.447982] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.448109] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.448150] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.448321] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.448434] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.448544] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3197cfcc-1b3e-4ef1-a343-d5e39684c0d2 already deleted. [ 1330.448656] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3197cfcc-1b3e-4ef1-a343-d5e39684c0d2" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.754493] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.754911] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.754911] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.755221] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.755442] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.755702] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Segment Port 42af6d2e-4c87-4459-9977-cb5c4109763c not found, creating... [ 1330.755986] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.756167] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.756345] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.756620] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.756772] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.757077] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.757236] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.757352] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.757561] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.757691] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.757829] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Resource: SegmentPort with ID: 42af6d2e-4c87-4459-9977-cb5c4109763c is going to be created. [ 1330.778761] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.779048] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.779150] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.779363] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.779596] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.779803] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "port-42af6d2e-4c87-4459-9977-cb5c4109763c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.473165] env[65065]: INFO networking_nsxv3.common.synchronization [req-7f3b9640-6fef-4cd6-8d9e-84bb2fc60540 req-b5943dcc-4576-49dd-83e7-f9f8b85b357f service nova] Enqueued Resource ID: 3197cfcc-1b3e-4ef1-a343-d5e39684c0d2 with Priority: HIGHEST for action security_group_rules [ 1331.473386] env[65065]: INFO networking_nsxv3.common.synchronization [req-7f3b9640-6fef-4cd6-8d9e-84bb2fc60540 req-b5943dcc-4576-49dd-83e7-f9f8b85b357f service nova] Enqueued Resource ID: 3197cfcc-1b3e-4ef1-a343-d5e39684c0d2 with Priority: HIGHEST for action security_group_members [ 1331.473581] env[65065]: INFO networking_nsxv3.common.synchronization [req-7f3b9640-6fef-4cd6-8d9e-84bb2fc60540 req-b5943dcc-4576-49dd-83e7-f9f8b85b357f service nova] Enqueued Resource ID: 42af6d2e-4c87-4459-9977-cb5c4109763c with Priority: HIGHEST for action port [ 1331.474143] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3197cfcc-1b3e-4ef1-a343-d5e39684c0d2 with Priority: HIGHEST for action security_group_rules [ 1331.474350] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3197cfcc-1b3e-4ef1-a343-d5e39684c0d2 with Priority: HIGHEST for action security_group_members [ 1331.474465] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42af6d2e-4c87-4459-9977-cb5c4109763c with Priority: HIGHEST for action port [ 1331.474788] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3197cfcc-1b3e-4ef1-a343-d5e39684c0d2 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.474913] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3197cfcc-1b3e-4ef1-a343-d5e39684c0d2" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.475007] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3197cfcc-1b3e-4ef1-a343-d5e39684c0d2" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.475250] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3197cfcc-1b3e-4ef1-a343-d5e39684c0d2" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.475341] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3197cfcc-1b3e-4ef1-a343-d5e39684c0d2',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1331.476177] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-3197cfcc-1b3e-4ef1-a343-d5e39684c0d2 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.476771] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3197cfcc-1b3e-4ef1-a343-d5e39684c0d2" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.476771] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3197cfcc-1b3e-4ef1-a343-d5e39684c0d2" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.476771] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3197cfcc-1b3e-4ef1-a343-d5e39684c0d2" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.476771] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.476771] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.476771] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.477122] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.477122] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.477122] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3197cfcc-1b3e-4ef1-a343-d5e39684c0d2',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1331.478262] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-42af6d2e-4c87-4459-9977-cb5c4109763c taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.478262] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-42af6d2e-4c87-4459-9977-cb5c4109763c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.478262] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-42af6d2e-4c87-4459-9977-cb5c4109763c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.478390] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-42af6d2e-4c87-4459-9977-cb5c4109763c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.478419] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('42af6d2e-4c87-4459-9977-cb5c4109763c',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1331.979617] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3197cfcc-1b3e-4ef1-a343-d5e39684c0d2',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1331.980728] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-3197cfcc-1b3e-4ef1-a343-d5e39684c0d2 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.980839] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3197cfcc-1b3e-4ef1-a343-d5e39684c0d2" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.981215] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 42af6d2e-4c87-4459-9977-cb5c4109763c with status ACTIVE [ 1331.981403] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.981519] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.981570] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.981765] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.981850] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.982023] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.982121] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.982180] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.982348] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.982424] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.982601] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.982688] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.982799] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.982880] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.982955] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.983053] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 42af6d2e-4c87-4459-9977-cb5c4109763c is going to be updated. [ 1332.003518] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.003718] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.003718] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.003906] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.004055] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.004208] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-42af6d2e-4c87-4459-9977-cb5c4109763c" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.012256] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e in Status: SUCCESS [ 1332.012418] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e deletion is rescheduled due to dependency. [ 1332.012563] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.481616] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3197cfcc-1b3e-4ef1-a343-d5e39684c0d2',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1332.984506] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.984917] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.984917] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.985027] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.985060] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.985183] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3197cfcc-1b3e-4ef1-a343-d5e39684c0d2 is going to be created. [ 1333.011433] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.011631] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.011631] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.011843] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.012014] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.043728] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3197cfcc-1b3e-4ef1-a343-d5e39684c0d2 in Status: UNINITIALIZED for 2s [ 1335.055051] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3197cfcc-1b3e-4ef1-a343-d5e39684c0d2 in Status: SUCCESS [ 1335.055463] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3197cfcc-1b3e-4ef1-a343-d5e39684c0d2" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.055463] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3197cfcc-1b3e-4ef1-a343-d5e39684c0d2" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.055647] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3197cfcc-1b3e-4ef1-a343-d5e39684c0d2" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.055854] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.055971] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.056038] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.056198] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.056272] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.056351] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3197cfcc-1b3e-4ef1-a343-d5e39684c0d2" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.056446] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3197cfcc-1b3e-4ef1-a343-d5e39684c0d2',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1335.558994] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3197cfcc-1b3e-4ef1-a343-d5e39684c0d2',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1336.061884] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3197cfcc-1b3e-4ef1-a343-d5e39684c0d2: rpc.has_security_group_logging(os_id): False [ 1336.080702] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1336.080881] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1336.080929] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1336.081257] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1336.081257] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1336.081683] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1336.081764] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1336.081824] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1336.082364] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1336.082364] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1336.082364] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3197cfcc-1b3e-4ef1-a343-d5e39684c0d2 is going to be created. [ 1336.226026] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1336.226250] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1336.226250] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1336.226462] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1336.226685] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1336.238306] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3197cfcc-1b3e-4ef1-a343-d5e39684c0d2 in Status: IN_PROGRESS for 2s [ 1336.475862] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1336.475994] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1338.252502] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3197cfcc-1b3e-4ef1-a343-d5e39684c0d2 in Status: SUCCESS [ 1338.252902] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3197cfcc-1b3e-4ef1-a343-d5e39684c0d2" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.845598] env[65065]: INFO networking_nsxv3.common.synchronization [None req-4bfcb1bd-d1f0-43d2-9da0-6f4e16160ea2 None None] Enqueued Resource ID: 7cc5520f-62d9-4169-88da-96fccfd3a75d with Priority: HIGHEST for action port [ 1338.845598] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cc5520f-62d9-4169-88da-96fccfd3a75d with Priority: HIGHEST for action port [ 1338.845598] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-7cc5520f-62d9-4169-88da-96fccfd3a75d taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.845598] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7cc5520f-62d9-4169-88da-96fccfd3a75d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.845598] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7cc5520f-62d9-4169-88da-96fccfd3a75d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.845598] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7cc5520f-62d9-4169-88da-96fccfd3a75d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.846143] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7cc5520f-62d9-4169-88da-96fccfd3a75d',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1339.349670] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7cc5520f-62d9-4169-88da-96fccfd3a75d [ 1339.349670] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.349975] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.349975] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.350065] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.350187] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.350243] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7cc5520f-62d9-4169-88da-96fccfd3a75d already deleted. [ 1339.350322] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7cc5520f-62d9-4169-88da-96fccfd3a75d" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.630133] env[65065]: INFO networking_nsxv3.common.synchronization [None req-a6443231-ebb9-40d8-92a1-42bc47f7932b None None] Enqueued Resource ID: ed5edd31-bcfd-4225-b28b-4e545c43cb26 with Priority: HIGHEST for action port [ 1340.630679] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed5edd31-bcfd-4225-b28b-4e545c43cb26 with Priority: HIGHEST for action port [ 1340.631032] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-ed5edd31-bcfd-4225-b28b-4e545c43cb26 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.631128] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ed5edd31-bcfd-4225-b28b-4e545c43cb26" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.631187] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ed5edd31-bcfd-4225-b28b-4e545c43cb26" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.631435] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ed5edd31-bcfd-4225-b28b-4e545c43cb26" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.631652] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ed5edd31-bcfd-4225-b28b-4e545c43cb26',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1341.134486] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ed5edd31-bcfd-4225-b28b-4e545c43cb26 [ 1341.134742] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.134877] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.134944] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.135186] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.135279] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.135398] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ed5edd31-bcfd-4225-b28b-4e545c43cb26 already deleted. [ 1341.135447] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ed5edd31-bcfd-4225-b28b-4e545c43cb26" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.948668] env[65065]: INFO networking_nsxv3.common.synchronization [req-6ba8ff2d-cf06-4bb6-a11d-2dcd5ae5fe99 req-1c377364-bf32-4a3d-9587-2afcbe0fdfec tempest-ServerRescueTestJSON-1820020502 tempest-ServerRescueTestJSON-1820020502-project-member] Enqueued Resource ID: 6eb70570-d335-47e5-a771-3fc3c1b8cdf4 with Priority: HIGHEST for action security_group_members [ 1343.949205] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6eb70570-d335-47e5-a771-3fc3c1b8cdf4 with Priority: HIGHEST for action security_group_members [ 1343.949511] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-6eb70570-d335-47e5-a771-3fc3c1b8cdf4 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.949644] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6eb70570-d335-47e5-a771-3fc3c1b8cdf4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.949733] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6eb70570-d335-47e5-a771-3fc3c1b8cdf4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.949940] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6eb70570-d335-47e5-a771-3fc3c1b8cdf4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.950224] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.950333] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.950395] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.950558] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.950643] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.950734] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6eb70570-d335-47e5-a771-3fc3c1b8cdf4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1344.268024] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock network-281 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.268173] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "network-281" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.268274] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "network-281" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.268606] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "network-281" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.268858] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.269024] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.269144] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.269352] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.269495] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.269742] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1344.269804] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1344.269906] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1344.270019] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1344.270161] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1344.270219] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1344.270346] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1344.291889] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1344.292072] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1344.292204] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1344.292377] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "network-281" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.292946] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock port-488dd3a2-1b6d-43a0-b96e-fb3246948c53 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.292946] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "port-488dd3a2-1b6d-43a0-b96e-fb3246948c53" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.293227] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "port-488dd3a2-1b6d-43a0-b96e-fb3246948c53" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.293377] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "port-488dd3a2-1b6d-43a0-b96e-fb3246948c53" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.293516] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('488dd3a2-1b6d-43a0-b96e-fb3246948c53',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1344.453388] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.453605] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.453605] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.453834] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.453925] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.454148] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.454239] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.454302] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.454500] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.454581] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.454667] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6eb70570-d335-47e5-a771-3fc3c1b8cdf4 already deleted. [ 1344.454746] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6eb70570-d335-47e5-a771-3fc3c1b8cdf4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.795508] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.795818] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.795949] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.796250] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.796398] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.796562] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Segment Port 488dd3a2-1b6d-43a0-b96e-fb3246948c53 not found, creating... [ 1344.796816] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.796964] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.797092] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.797300] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.797432] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.797703] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.797852] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.797962] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.798171] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.798297] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.798429] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Resource: SegmentPort with ID: 488dd3a2-1b6d-43a0-b96e-fb3246948c53 is going to be created. [ 1344.819309] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.819501] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.819603] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.819858] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.820084] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.820303] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "port-488dd3a2-1b6d-43a0-b96e-fb3246948c53" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.520217] env[65065]: INFO networking_nsxv3.common.synchronization [req-6ba8ff2d-cf06-4bb6-a11d-2dcd5ae5fe99 req-8def9f4d-bb3b-4efd-a517-2aa6e77a1dc7 service nova] Enqueued Resource ID: 6eb70570-d335-47e5-a771-3fc3c1b8cdf4 with Priority: HIGHEST for action security_group_rules [ 1345.520452] env[65065]: INFO networking_nsxv3.common.synchronization [req-6ba8ff2d-cf06-4bb6-a11d-2dcd5ae5fe99 req-8def9f4d-bb3b-4efd-a517-2aa6e77a1dc7 service nova] Enqueued Resource ID: 6eb70570-d335-47e5-a771-3fc3c1b8cdf4 with Priority: HIGHEST for action security_group_members [ 1345.520452] env[65065]: INFO networking_nsxv3.common.synchronization [req-6ba8ff2d-cf06-4bb6-a11d-2dcd5ae5fe99 req-8def9f4d-bb3b-4efd-a517-2aa6e77a1dc7 service nova] Enqueued Resource ID: 488dd3a2-1b6d-43a0-b96e-fb3246948c53 with Priority: HIGHEST for action port [ 1345.520645] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6eb70570-d335-47e5-a771-3fc3c1b8cdf4 with Priority: HIGHEST for action security_group_rules [ 1345.520775] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6eb70570-d335-47e5-a771-3fc3c1b8cdf4 with Priority: HIGHEST for action security_group_members [ 1345.520868] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 488dd3a2-1b6d-43a0-b96e-fb3246948c53 with Priority: HIGHEST for action port [ 1345.521444] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6eb70570-d335-47e5-a771-3fc3c1b8cdf4 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.521548] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6eb70570-d335-47e5-a771-3fc3c1b8cdf4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.521652] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6eb70570-d335-47e5-a771-3fc3c1b8cdf4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.521859] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6eb70570-d335-47e5-a771-3fc3c1b8cdf4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.521985] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6eb70570-d335-47e5-a771-3fc3c1b8cdf4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1345.523647] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-6eb70570-d335-47e5-a771-3fc3c1b8cdf4 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.523647] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6eb70570-d335-47e5-a771-3fc3c1b8cdf4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.523792] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6eb70570-d335-47e5-a771-3fc3c1b8cdf4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.523831] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6eb70570-d335-47e5-a771-3fc3c1b8cdf4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.525265] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.525265] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.525265] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.525265] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.525265] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.525265] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6eb70570-d335-47e5-a771-3fc3c1b8cdf4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1345.525891] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-488dd3a2-1b6d-43a0-b96e-fb3246948c53 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.526039] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-488dd3a2-1b6d-43a0-b96e-fb3246948c53" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.526129] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-488dd3a2-1b6d-43a0-b96e-fb3246948c53" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.526352] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-488dd3a2-1b6d-43a0-b96e-fb3246948c53" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.526394] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('488dd3a2-1b6d-43a0-b96e-fb3246948c53',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1346.023784] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-6eb70570-d335-47e5-a771-3fc3c1b8cdf4 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.024041] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6eb70570-d335-47e5-a771-3fc3c1b8cdf4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.026234] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6eb70570-d335-47e5-a771-3fc3c1b8cdf4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1346.029243] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 488dd3a2-1b6d-43a0-b96e-fb3246948c53 with status ACTIVE [ 1346.029243] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.029243] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.029516] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.029554] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.029673] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.029820] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.029911] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.030212] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.030212] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.030212] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.030374] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.030447] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.030510] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.030627] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.030744] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.030799] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 488dd3a2-1b6d-43a0-b96e-fb3246948c53 is going to be updated. [ 1346.058978] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.058978] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.058978] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.058978] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.059347] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.059457] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-488dd3a2-1b6d-43a0-b96e-fb3246948c53" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.528661] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6eb70570-d335-47e5-a771-3fc3c1b8cdf4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1347.030941] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.031184] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.031184] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.031386] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.031477] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.031577] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6eb70570-d335-47e5-a771-3fc3c1b8cdf4 is going to be created. [ 1347.056244] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.056455] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.056455] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.056624] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.056794] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.066199] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6eb70570-d335-47e5-a771-3fc3c1b8cdf4 in Status: UNINITIALIZED for 2s [ 1349.077497] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6eb70570-d335-47e5-a771-3fc3c1b8cdf4 in Status: SUCCESS [ 1349.077889] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6eb70570-d335-47e5-a771-3fc3c1b8cdf4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.077961] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6eb70570-d335-47e5-a771-3fc3c1b8cdf4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.078188] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6eb70570-d335-47e5-a771-3fc3c1b8cdf4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.078377] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.078492] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.078556] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.078704] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.078782] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.078865] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6eb70570-d335-47e5-a771-3fc3c1b8cdf4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.078955] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6eb70570-d335-47e5-a771-3fc3c1b8cdf4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1349.581447] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-6eb70570-d335-47e5-a771-3fc3c1b8cdf4 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.581724] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6eb70570-d335-47e5-a771-3fc3c1b8cdf4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.581724] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6eb70570-d335-47e5-a771-3fc3c1b8cdf4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.581832] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6eb70570-d335-47e5-a771-3fc3c1b8cdf4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.581999] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.582116] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.582183] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.582338] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.582450] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.582543] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6eb70570-d335-47e5-a771-3fc3c1b8cdf4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.582697] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-6eb70570-d335-47e5-a771-3fc3c1b8cdf4 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.582791] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6eb70570-d335-47e5-a771-3fc3c1b8cdf4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.582854] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6eb70570-d335-47e5-a771-3fc3c1b8cdf4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.582985] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6eb70570-d335-47e5-a771-3fc3c1b8cdf4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.583135] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.583227] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.583288] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.583425] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.583499] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.583579] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6eb70570-d335-47e5-a771-3fc3c1b8cdf4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.583665] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6eb70570-d335-47e5-a771-3fc3c1b8cdf4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1350.086436] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6eb70570-d335-47e5-a771-3fc3c1b8cdf4: rpc.has_security_group_logging(os_id): False [ 1350.103381] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.103618] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.103618] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.103790] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.103878] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.104109] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.104212] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.104275] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.104423] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.104500] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.104679] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.104773] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.104834] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.104967] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.105055] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.105225] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.105317] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.105374] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.105543] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.105616] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.105679] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6eb70570-d335-47e5-a771-3fc3c1b8cdf4 is going to be created. [ 1350.158445] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.158646] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.158646] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.158864] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.159053] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.169125] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6eb70570-d335-47e5-a771-3fc3c1b8cdf4 in Status: IN_PROGRESS for 2s [ 1350.521469] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1350.521670] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1352.182095] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6eb70570-d335-47e5-a771-3fc3c1b8cdf4 in Status: SUCCESS [ 1352.182555] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6eb70570-d335-47e5-a771-3fc3c1b8cdf4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.522717] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1355.522717] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1360.523886] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1360.524158] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1361.524432] env[65065]: INFO networking_nsxv3.common.synchronization [req-dec8dc7c-b06e-4b94-9727-307a04a9403b req-56a6757f-d838-42cf-9755-8168d74f566a tempest-ServerRescueNegativeTestJSON-1519189094 tempest-ServerRescueNegativeTestJSON-1519189094-project-member] Enqueued Resource ID: eb00c909-3649-4026-9f97-79b0f488a362 with Priority: HIGHEST for action security_group_members [ 1361.525159] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb00c909-3649-4026-9f97-79b0f488a362 with Priority: HIGHEST for action security_group_members [ 1361.525521] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb00c909-3649-4026-9f97-79b0f488a362 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.525675] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb00c909-3649-4026-9f97-79b0f488a362" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.525753] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb00c909-3649-4026-9f97-79b0f488a362" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.525956] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb00c909-3649-4026-9f97-79b0f488a362" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.526130] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.526233] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.526287] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.526422] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.526504] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.526594] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eb00c909-3649-4026-9f97-79b0f488a362',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1362.030033] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.030033] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.030033] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.030033] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.030033] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.030468] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.030468] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.030468] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.030611] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.030723] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.030785] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eb00c909-3649-4026-9f97-79b0f488a362 is going to be updated. [ 1362.061744] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.062073] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.062168] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.062412] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.062629] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.072148] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb00c909-3649-4026-9f97-79b0f488a362 in Status: IN_PROGRESS for 2s [ 1364.083245] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb00c909-3649-4026-9f97-79b0f488a362 in Status: SUCCESS [ 1364.084108] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eb00c909-3649-4026-9f97-79b0f488a362 deletion is rescheduled due to dependency. [ 1364.084108] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb00c909-3649-4026-9f97-79b0f488a362" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.145781] env[65065]: INFO networking_nsxv3.common.synchronization [req-3a9720dd-36c2-4faa-acff-030df842efae req-701c178e-e081-49f3-aeb3-4d4043bfebbe tempest-ServerRescueTestJSON-1820020502 tempest-ServerRescueTestJSON-1820020502-project-member] Enqueued Resource ID: 6eb70570-d335-47e5-a771-3fc3c1b8cdf4 with Priority: HIGHEST for action security_group_members [ 1366.148765] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6eb70570-d335-47e5-a771-3fc3c1b8cdf4 with Priority: HIGHEST for action security_group_members [ 1366.148765] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-6eb70570-d335-47e5-a771-3fc3c1b8cdf4 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.148765] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6eb70570-d335-47e5-a771-3fc3c1b8cdf4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.148765] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6eb70570-d335-47e5-a771-3fc3c1b8cdf4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.148765] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6eb70570-d335-47e5-a771-3fc3c1b8cdf4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.148765] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.148765] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.148765] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.148765] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.148765] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.148765] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6eb70570-d335-47e5-a771-3fc3c1b8cdf4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1366.429786] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock network-281 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.430087] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "network-281" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.430207] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "network-281" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.430535] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "network-281" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.430771] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.430941] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.431306] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.431559] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.431717] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.431932] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1366.432049] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1366.432156] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1366.432261] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1366.432365] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1366.432467] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1366.432595] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1366.452498] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1366.452730] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1366.452831] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1366.453013] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "network-281" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.453351] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock port-d83cd922-8187-4ffe-87ae-faf1931be727 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.453519] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "port-d83cd922-8187-4ffe-87ae-faf1931be727" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.453633] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "port-d83cd922-8187-4ffe-87ae-faf1931be727" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.453948] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "port-d83cd922-8187-4ffe-87ae-faf1931be727" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.454098] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d83cd922-8187-4ffe-87ae-faf1931be727',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1366.650981] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6eb70570-d335-47e5-a771-3fc3c1b8cdf4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1366.956350] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.956696] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.956912] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.957333] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.957517] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.957671] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Segment Port d83cd922-8187-4ffe-87ae-faf1931be727 not found, creating... [ 1366.957945] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.958108] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.958227] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.958441] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.958576] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.958851] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.959007] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.959128] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.959328] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.959457] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.959595] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Resource: SegmentPort with ID: d83cd922-8187-4ffe-87ae-faf1931be727 is going to be created. [ 1366.978900] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.979128] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.979238] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.979504] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.979719] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.979937] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "port-d83cd922-8187-4ffe-87ae-faf1931be727" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.154063] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6eb70570-d335-47e5-a771-3fc3c1b8cdf4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1367.656782] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.656950] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.657040] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.657263] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.657360] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.657460] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6eb70570-d335-47e5-a771-3fc3c1b8cdf4 is going to be updated. [ 1367.674369] env[65065]: INFO networking_nsxv3.common.synchronization [req-3a9720dd-36c2-4faa-acff-030df842efae req-6b146134-b72f-49f9-b5f6-96e094c68bbd service nova] Enqueued Resource ID: 6eb70570-d335-47e5-a771-3fc3c1b8cdf4 with Priority: HIGHEST for action security_group_rules [ 1367.674369] env[65065]: INFO networking_nsxv3.common.synchronization [req-3a9720dd-36c2-4faa-acff-030df842efae req-6b146134-b72f-49f9-b5f6-96e094c68bbd service nova] Enqueued Resource ID: 6eb70570-d335-47e5-a771-3fc3c1b8cdf4 with Priority: HIGHEST for action security_group_members [ 1367.674369] env[65065]: INFO networking_nsxv3.common.synchronization [req-3a9720dd-36c2-4faa-acff-030df842efae req-6b146134-b72f-49f9-b5f6-96e094c68bbd service nova] Enqueued Resource ID: d83cd922-8187-4ffe-87ae-faf1931be727 with Priority: HIGHEST for action port [ 1367.674885] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6eb70570-d335-47e5-a771-3fc3c1b8cdf4 with Priority: HIGHEST for action security_group_rules [ 1367.675022] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6eb70570-d335-47e5-a771-3fc3c1b8cdf4 with Priority: HIGHEST for action security_group_members [ 1367.675079] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d83cd922-8187-4ffe-87ae-faf1931be727 with Priority: HIGHEST for action port [ 1367.675356] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6eb70570-d335-47e5-a771-3fc3c1b8cdf4 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.675471] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6eb70570-d335-47e5-a771-3fc3c1b8cdf4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.675588] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6eb70570-d335-47e5-a771-3fc3c1b8cdf4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.675792] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6eb70570-d335-47e5-a771-3fc3c1b8cdf4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.675935] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6eb70570-d335-47e5-a771-3fc3c1b8cdf4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1367.677745] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-6eb70570-d335-47e5-a771-3fc3c1b8cdf4 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.677745] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6eb70570-d335-47e5-a771-3fc3c1b8cdf4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.677883] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-d83cd922-8187-4ffe-87ae-faf1931be727 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.677883] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d83cd922-8187-4ffe-87ae-faf1931be727" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.678103] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d83cd922-8187-4ffe-87ae-faf1931be727" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.678315] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d83cd922-8187-4ffe-87ae-faf1931be727" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.678481] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d83cd922-8187-4ffe-87ae-faf1931be727',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1367.689522] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.689705] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.689761] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.689925] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.690092] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.700085] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6eb70570-d335-47e5-a771-3fc3c1b8cdf4 in Status: IN_PROGRESS for 2s [ 1368.180846] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d83cd922-8187-4ffe-87ae-faf1931be727 with status ACTIVE [ 1368.181238] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.181238] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.181450] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.181563] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.181610] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.181813] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.181864] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.181919] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.182070] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.182145] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.182319] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.182424] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.182485] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.182633] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.182738] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.182810] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d83cd922-8187-4ffe-87ae-faf1931be727 is going to be updated. [ 1368.183949] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-6eb70570-d335-47e5-a771-3fc3c1b8cdf4 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.184457] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6eb70570-d335-47e5-a771-3fc3c1b8cdf4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.206080] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.206305] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.206305] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.206549] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.206693] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.206858] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d83cd922-8187-4ffe-87ae-faf1931be727" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1369.711892] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6eb70570-d335-47e5-a771-3fc3c1b8cdf4 in Status: SUCCESS [ 1369.711892] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6eb70570-d335-47e5-a771-3fc3c1b8cdf4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1369.711892] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6eb70570-d335-47e5-a771-3fc3c1b8cdf4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1369.712546] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6eb70570-d335-47e5-a771-3fc3c1b8cdf4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1369.712546] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1369.712546] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1369.712546] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1369.712546] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1369.712860] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1369.712860] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6eb70570-d335-47e5-a771-3fc3c1b8cdf4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1370.214867] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6eb70570-d335-47e5-a771-3fc3c1b8cdf4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1370.717428] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6eb70570-d335-47e5-a771-3fc3c1b8cdf4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1371.220135] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1371.220326] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1371.220399] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1371.220613] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1371.220709] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1371.220830] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6eb70570-d335-47e5-a771-3fc3c1b8cdf4 is going to be updated. [ 1371.248025] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1371.248230] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1371.248304] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1371.248513] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1371.248682] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1371.257298] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6eb70570-d335-47e5-a771-3fc3c1b8cdf4 in Status: IN_PROGRESS for 2s [ 1372.676135] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1372.676486] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1373.270440] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6eb70570-d335-47e5-a771-3fc3c1b8cdf4 in Status: SUCCESS [ 1373.270633] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6eb70570-d335-47e5-a771-3fc3c1b8cdf4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.270798] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6eb70570-d335-47e5-a771-3fc3c1b8cdf4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.271079] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6eb70570-d335-47e5-a771-3fc3c1b8cdf4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.271282] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.271418] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.271483] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.271642] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.271717] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.271809] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6eb70570-d335-47e5-a771-3fc3c1b8cdf4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.271905] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6eb70570-d335-47e5-a771-3fc3c1b8cdf4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1373.774267] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-6eb70570-d335-47e5-a771-3fc3c1b8cdf4 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.774696] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6eb70570-d335-47e5-a771-3fc3c1b8cdf4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.774696] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6eb70570-d335-47e5-a771-3fc3c1b8cdf4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.774696] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6eb70570-d335-47e5-a771-3fc3c1b8cdf4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.774896] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.774999] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.775101] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.775314] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.775402] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.775513] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6eb70570-d335-47e5-a771-3fc3c1b8cdf4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.775685] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-6eb70570-d335-47e5-a771-3fc3c1b8cdf4 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.775786] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6eb70570-d335-47e5-a771-3fc3c1b8cdf4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.775849] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6eb70570-d335-47e5-a771-3fc3c1b8cdf4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.775989] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6eb70570-d335-47e5-a771-3fc3c1b8cdf4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.776155] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.776288] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.776382] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.776564] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.776694] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.776786] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6eb70570-d335-47e5-a771-3fc3c1b8cdf4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.776879] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6eb70570-d335-47e5-a771-3fc3c1b8cdf4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1374.280097] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6eb70570-d335-47e5-a771-3fc3c1b8cdf4: rpc.has_security_group_logging(os_id): False [ 1374.303649] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.303876] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.303876] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.304162] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.304261] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.304483] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.304590] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.304658] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.304871] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.304937] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.305146] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.305242] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.305297] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.305443] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.305518] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.305691] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.305785] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.305849] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.305991] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.306080] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.306168] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6eb70570-d335-47e5-a771-3fc3c1b8cdf4 is going to be updated. [ 1374.388466] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.388794] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.388794] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.388982] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.389078] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.406928] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6eb70570-d335-47e5-a771-3fc3c1b8cdf4 in Status: IN_PROGRESS for 2s [ 1374.772921] env[65065]: INFO networking_nsxv3.common.synchronization [req-cef7ffdc-6b77-4e12-83b8-1231487cbbb5 req-2b84f685-8dda-49f8-88e9-8fdde5876ebf tempest-ServerRescueNegativeTestJSON-1519189094 tempest-ServerRescueNegativeTestJSON-1519189094-project-member] Enqueued Resource ID: a057519d-085e-4b14-acb1-755fbec909af with Priority: HIGHEST for action security_group_members [ 1374.773485] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a057519d-085e-4b14-acb1-755fbec909af with Priority: HIGHEST for action security_group_members [ 1374.773786] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-a057519d-085e-4b14-acb1-755fbec909af taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.773909] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a057519d-085e-4b14-acb1-755fbec909af" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.773971] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a057519d-085e-4b14-acb1-755fbec909af" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.774178] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a057519d-085e-4b14-acb1-755fbec909af" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.774327] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.774530] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.774530] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.774960] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.774960] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.774960] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a057519d-085e-4b14-acb1-755fbec909af',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1375.276564] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a057519d-085e-4b14-acb1-755fbec909af',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1375.778828] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a057519d-085e-4b14-acb1-755fbec909af',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1376.281585] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1376.281827] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1376.281930] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1376.282205] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1376.282332] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1376.282439] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a057519d-085e-4b14-acb1-755fbec909af is going to be updated. [ 1376.311042] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1376.311163] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1376.311163] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1376.311363] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1376.311712] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1376.322481] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a057519d-085e-4b14-acb1-755fbec909af in Status: IN_PROGRESS for 2s [ 1376.421369] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6eb70570-d335-47e5-a771-3fc3c1b8cdf4 in Status: SUCCESS [ 1376.421681] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6eb70570-d335-47e5-a771-3fc3c1b8cdf4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1378.334740] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a057519d-085e-4b14-acb1-755fbec909af in Status: SUCCESS [ 1378.335259] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a057519d-085e-4b14-acb1-755fbec909af" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1379.775042] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1379.775346] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1381.326538] env[65065]: INFO networking_nsxv3.common.synchronization [req-3fe2f050-36bc-4e27-9838-6183bc4ea365 req-6f97da7e-7063-4670-bb97-1470f3e977b3 tempest-ServerRescueNegativeTestJSON-1519189094 tempest-ServerRescueNegativeTestJSON-1519189094-project-member] Enqueued Resource ID: a057519d-085e-4b14-acb1-755fbec909af with Priority: HIGHEST for action security_group_members [ 1381.326726] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a057519d-085e-4b14-acb1-755fbec909af with Priority: HIGHEST for action security_group_members [ 1381.326886] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-a057519d-085e-4b14-acb1-755fbec909af taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1381.327017] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a057519d-085e-4b14-acb1-755fbec909af" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1381.327087] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a057519d-085e-4b14-acb1-755fbec909af" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1381.327282] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a057519d-085e-4b14-acb1-755fbec909af" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1381.327431] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1381.327522] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1381.327581] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1381.327719] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1381.327800] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1381.327890] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a057519d-085e-4b14-acb1-755fbec909af',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1381.832407] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1381.832568] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1381.832640] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1381.832857] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1381.832950] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1381.833550] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1381.833550] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1381.833550] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1381.833550] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1381.833797] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1381.833797] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a057519d-085e-4b14-acb1-755fbec909af is going to be updated. [ 1381.861048] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1381.861211] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1381.861303] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1381.861480] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1381.861617] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1381.870251] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a057519d-085e-4b14-acb1-755fbec909af in Status: IN_PROGRESS for 2s [ 1383.882937] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a057519d-085e-4b14-acb1-755fbec909af in Status: SUCCESS [ 1383.882937] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a057519d-085e-4b14-acb1-755fbec909af deletion is rescheduled due to dependency. [ 1383.882937] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a057519d-085e-4b14-acb1-755fbec909af" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.327834] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1386.328199] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1390.341926] env[65065]: INFO networking_nsxv3.common.synchronization [req-cf52bf0a-f777-4260-a113-d184b936f999 req-75846e39-ce78-46a6-a4f8-152346f80936 tempest-ServerRescueTestJSON-1820020502 tempest-ServerRescueTestJSON-1820020502-project-member] Enqueued Resource ID: 6eb70570-d335-47e5-a771-3fc3c1b8cdf4 with Priority: HIGHEST for action security_group_members [ 1390.342275] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6eb70570-d335-47e5-a771-3fc3c1b8cdf4 with Priority: HIGHEST for action security_group_members [ 1390.343182] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-6eb70570-d335-47e5-a771-3fc3c1b8cdf4 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.343182] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6eb70570-d335-47e5-a771-3fc3c1b8cdf4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.343182] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6eb70570-d335-47e5-a771-3fc3c1b8cdf4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.343182] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6eb70570-d335-47e5-a771-3fc3c1b8cdf4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.344814] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.344956] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.345010] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.345174] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.345262] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.345353] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6eb70570-d335-47e5-a771-3fc3c1b8cdf4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1390.847036] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6eb70570-d335-47e5-a771-3fc3c1b8cdf4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1391.349704] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6eb70570-d335-47e5-a771-3fc3c1b8cdf4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1391.852629] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1391.852803] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1391.852860] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.853105] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.853197] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.853295] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6eb70570-d335-47e5-a771-3fc3c1b8cdf4 is going to be updated. [ 1391.884618] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1391.884776] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1391.884819] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.885085] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.885230] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.896740] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6eb70570-d335-47e5-a771-3fc3c1b8cdf4 in Status: IN_PROGRESS for 2s [ 1393.909051] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6eb70570-d335-47e5-a771-3fc3c1b8cdf4 in Status: SUCCESS [ 1393.909433] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6eb70570-d335-47e5-a771-3fc3c1b8cdf4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1395.343531] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1395.343958] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1396.968478] env[65065]: INFO networking_nsxv3.common.synchronization [req-15121480-2cea-4eeb-a4ab-02f179f02674 req-119a1bc5-7045-4527-a88f-e0acefc7ad43 tempest-ServerRescueTestJSON-1820020502 tempest-ServerRescueTestJSON-1820020502-project-member] Enqueued Resource ID: 6eb70570-d335-47e5-a771-3fc3c1b8cdf4 with Priority: HIGHEST for action security_group_members [ 1396.969017] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6eb70570-d335-47e5-a771-3fc3c1b8cdf4 with Priority: HIGHEST for action security_group_members [ 1396.969332] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-6eb70570-d335-47e5-a771-3fc3c1b8cdf4 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1396.969472] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6eb70570-d335-47e5-a771-3fc3c1b8cdf4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1396.969537] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6eb70570-d335-47e5-a771-3fc3c1b8cdf4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1396.969730] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6eb70570-d335-47e5-a771-3fc3c1b8cdf4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1396.969887] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1396.969981] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1396.970051] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1396.970197] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1396.970279] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1396.970370] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6eb70570-d335-47e5-a771-3fc3c1b8cdf4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1397.472332] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1397.472534] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1397.472534] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1397.472803] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1397.472923] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1397.473180] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1397.473294] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1397.473359] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1397.473553] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1397.473632] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1397.473718] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6eb70570-d335-47e5-a771-3fc3c1b8cdf4 is going to be updated. [ 1397.502735] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1397.502906] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1397.502906] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1397.503097] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1397.503239] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1397.511475] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6eb70570-d335-47e5-a771-3fc3c1b8cdf4 in Status: IN_PROGRESS for 2s [ 1399.521648] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6eb70570-d335-47e5-a771-3fc3c1b8cdf4 in Status: SUCCESS [ 1399.522030] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6eb70570-d335-47e5-a771-3fc3c1b8cdf4 deletion is rescheduled due to dependency. [ 1399.522030] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6eb70570-d335-47e5-a771-3fc3c1b8cdf4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1401.970357] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1401.970727] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1406.972029] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1406.972448] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1411.973879] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1411.974261] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1416.975660] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1416.976075] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1421.976676] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1421.977056] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1426.977678] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1426.978213] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1431.979393] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1431.979770] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1436.980710] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1436.981128] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1441.981826] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1441.982272] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1446.983765] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1446.984166] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1451.985403] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1451.985403] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1456.986336] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1456.986336] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1461.988108] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1461.988518] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1466.989178] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1466.989585] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1471.990987] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1471.991442] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1476.992204] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1476.992541] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1478.390981] env[65065]: INFO networking_nsxv3.common.synchronization [req-f2048c92-5613-41c0-8b2e-9119b9f85106 req-94498edd-b51c-4349-92c4-47075f85c173 tempest-AttachVolumeTestJSON-207450638 tempest-AttachVolumeTestJSON-207450638-project-member] Enqueued Resource ID: 3197cfcc-1b3e-4ef1-a343-d5e39684c0d2 with Priority: HIGHEST for action security_group_members [ 1478.391552] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3197cfcc-1b3e-4ef1-a343-d5e39684c0d2 with Priority: HIGHEST for action security_group_members [ 1478.391871] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-3197cfcc-1b3e-4ef1-a343-d5e39684c0d2 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1478.392093] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3197cfcc-1b3e-4ef1-a343-d5e39684c0d2" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1478.392093] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3197cfcc-1b3e-4ef1-a343-d5e39684c0d2" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1478.392265] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3197cfcc-1b3e-4ef1-a343-d5e39684c0d2" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1478.392415] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1478.392511] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1478.392569] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1478.392709] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1478.392793] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1478.392884] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3197cfcc-1b3e-4ef1-a343-d5e39684c0d2',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1478.895106] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1478.895322] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1478.895322] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1478.895497] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1478.895588] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1478.895846] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1478.895950] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1478.896026] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1478.896189] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1478.896267] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1478.896364] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3197cfcc-1b3e-4ef1-a343-d5e39684c0d2 is going to be updated. [ 1478.929733] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1478.929940] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1478.929940] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1478.930132] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1478.930270] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1478.937889] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3197cfcc-1b3e-4ef1-a343-d5e39684c0d2 in Status: IN_PROGRESS for 2s [ 1480.949415] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3197cfcc-1b3e-4ef1-a343-d5e39684c0d2 in Status: SUCCESS [ 1480.949791] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3197cfcc-1b3e-4ef1-a343-d5e39684c0d2 deletion is rescheduled due to dependency. [ 1480.949791] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3197cfcc-1b3e-4ef1-a343-d5e39684c0d2" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1483.177284] env[65065]: INFO networking_nsxv3.common.synchronization [None req-74327a2e-8097-46c9-9a74-4672f49028ad tempest-AttachVolumeTestJSON-207450638 tempest-AttachVolumeTestJSON-207450638-project-member] Enqueued Resource ID: e5af3025-e700-40cd-be52-f7ebbf00239f with Priority: HIGHEST for action security_group_rules [ 1483.177797] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5af3025-e700-40cd-be52-f7ebbf00239f with Priority: HIGHEST for action security_group_rules [ 1483.178175] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e5af3025-e700-40cd-be52-f7ebbf00239f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.178352] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e5af3025-e700-40cd-be52-f7ebbf00239f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1483.178462] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e5af3025-e700-40cd-be52-f7ebbf00239f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1483.178827] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e5af3025-e700-40cd-be52-f7ebbf00239f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1483.178916] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e5af3025-e700-40cd-be52-f7ebbf00239f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1483.254100] env[65065]: INFO networking_nsxv3.common.synchronization [None req-14fa7dd9-a0b3-4d8d-a053-391d2a5153f1 tempest-AttachVolumeTestJSON-207450638 tempest-AttachVolumeTestJSON-207450638-project-member] Enqueued Resource ID: e5af3025-e700-40cd-be52-f7ebbf00239f with Priority: HIGHEST for action security_group_rules [ 1483.254592] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5af3025-e700-40cd-be52-f7ebbf00239f with Priority: HIGHEST for action security_group_rules [ 1483.254897] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e5af3025-e700-40cd-be52-f7ebbf00239f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.255000] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e5af3025-e700-40cd-be52-f7ebbf00239f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1483.700441] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.700754] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1483.700754] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1483.701154] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1483.701154] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1483.701154] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e5af3025-e700-40cd-be52-f7ebbf00239f already deleted. [ 1483.701273] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e5af3025-e700-40cd-be52-f7ebbf00239f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1483.701445] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e5af3025-e700-40cd-be52-f7ebbf00239f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1483.701676] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e5af3025-e700-40cd-be52-f7ebbf00239f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1483.701787] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e5af3025-e700-40cd-be52-f7ebbf00239f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1484.222741] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1484.223141] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1484.223141] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1484.223288] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1484.223384] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1484.223479] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e5af3025-e700-40cd-be52-f7ebbf00239f already deleted. [ 1484.223559] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e5af3025-e700-40cd-be52-f7ebbf00239f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1485.092715] env[65065]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-5dc288ef-8933-4403-998f-272fe36b910d None None] NSXv3 Agent Agent loop - iteration:3 completed [ 1485.092851] env[65065]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-5dc288ef-8933-4403-998f-272fe36b910d None None] NSXv3 Agent Agent loop - iteration:4 started [ 1488.255416] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1488.255653] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1488.552697] env[65065]: INFO networking_nsxv3.common.synchronization [req-ee2826f1-6f21-4bc6-b82d-bbfcf541da8d req-7065e40b-3ed4-4e50-bbc8-6ca32b063aa7 tempest-AttachVolumeTestJSON-207450638 tempest-AttachVolumeTestJSON-207450638-project-member] Enqueued Resource ID: e5af3025-e700-40cd-be52-f7ebbf00239f with Priority: HIGHEST for action security_group_members [ 1488.553242] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5af3025-e700-40cd-be52-f7ebbf00239f with Priority: HIGHEST for action security_group_members [ 1488.553550] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5af3025-e700-40cd-be52-f7ebbf00239f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1488.553669] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5af3025-e700-40cd-be52-f7ebbf00239f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1488.553735] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5af3025-e700-40cd-be52-f7ebbf00239f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1488.554181] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5af3025-e700-40cd-be52-f7ebbf00239f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1488.554403] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1488.554467] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1488.554521] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1488.554684] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1488.554769] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1488.554864] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e5af3025-e700-40cd-be52-f7ebbf00239f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1488.836539] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock network-410 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1488.836742] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "network-410" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1488.836894] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "network-410" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1488.837193] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "network-410" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1488.837451] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1488.837609] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1488.837747] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1488.837970] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1488.838162] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1488.838372] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1488.838483] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1488.838587] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1488.838692] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1488.838797] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1488.838900] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1488.839038] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1488.858828] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1488.858997] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1488.859156] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1488.859319] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "network-410" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1488.859621] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock port-906c89a4-2b84-43c4-aec8-0bf2386ba12e taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1488.859786] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "port-906c89a4-2b84-43c4-aec8-0bf2386ba12e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1488.859902] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "port-906c89a4-2b84-43c4-aec8-0bf2386ba12e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1488.860251] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "port-906c89a4-2b84-43c4-aec8-0bf2386ba12e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1488.860387] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('906c89a4-2b84-43c4-aec8-0bf2386ba12e',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1489.057454] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1489.057661] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1489.057661] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1489.057868] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1489.057959] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1489.058173] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1489.058270] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1489.058332] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1489.058482] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1489.058554] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1489.058637] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5af3025-e700-40cd-be52-f7ebbf00239f already deleted. [ 1489.058716] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5af3025-e700-40cd-be52-f7ebbf00239f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1489.362510] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1489.362856] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1489.362927] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1489.363181] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1489.363434] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1489.363483] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Segment Port 906c89a4-2b84-43c4-aec8-0bf2386ba12e not found, creating... [ 1489.363740] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1489.363927] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1489.364063] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1489.364291] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1489.364429] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1489.364710] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1489.364866] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1489.364983] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1489.365200] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1489.365360] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1489.365594] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Resource: SegmentPort with ID: 906c89a4-2b84-43c4-aec8-0bf2386ba12e is going to be created. [ 1489.392322] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1489.392525] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1489.392642] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1489.392905] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1489.393148] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1489.393373] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "port-906c89a4-2b84-43c4-aec8-0bf2386ba12e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1490.072320] env[65065]: INFO networking_nsxv3.common.synchronization [req-ee2826f1-6f21-4bc6-b82d-bbfcf541da8d req-eff22254-88c4-4e27-9129-50071a75867c service nova] Enqueued Resource ID: e5af3025-e700-40cd-be52-f7ebbf00239f with Priority: HIGHEST for action security_group_rules [ 1490.072500] env[65065]: INFO networking_nsxv3.common.synchronization [req-ee2826f1-6f21-4bc6-b82d-bbfcf541da8d req-eff22254-88c4-4e27-9129-50071a75867c service nova] Enqueued Resource ID: e5af3025-e700-40cd-be52-f7ebbf00239f with Priority: HIGHEST for action security_group_members [ 1490.072978] env[65065]: INFO networking_nsxv3.common.synchronization [req-ee2826f1-6f21-4bc6-b82d-bbfcf541da8d req-eff22254-88c4-4e27-9129-50071a75867c service nova] Enqueued Resource ID: 906c89a4-2b84-43c4-aec8-0bf2386ba12e with Priority: HIGHEST for action port [ 1490.073550] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5af3025-e700-40cd-be52-f7ebbf00239f with Priority: HIGHEST for action security_group_rules [ 1490.073692] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5af3025-e700-40cd-be52-f7ebbf00239f with Priority: HIGHEST for action security_group_members [ 1490.073789] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 906c89a4-2b84-43c4-aec8-0bf2386ba12e with Priority: HIGHEST for action port [ 1490.074127] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e5af3025-e700-40cd-be52-f7ebbf00239f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1490.074263] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e5af3025-e700-40cd-be52-f7ebbf00239f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1490.074329] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e5af3025-e700-40cd-be52-f7ebbf00239f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1490.074526] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e5af3025-e700-40cd-be52-f7ebbf00239f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1490.074607] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e5af3025-e700-40cd-be52-f7ebbf00239f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1490.076123] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5af3025-e700-40cd-be52-f7ebbf00239f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1490.076323] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5af3025-e700-40cd-be52-f7ebbf00239f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1490.076433] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5af3025-e700-40cd-be52-f7ebbf00239f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1490.076668] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5af3025-e700-40cd-be52-f7ebbf00239f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1490.076879] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1490.077014] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1490.077101] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1490.077287] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1490.077388] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1490.077487] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e5af3025-e700-40cd-be52-f7ebbf00239f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1490.079117] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-906c89a4-2b84-43c4-aec8-0bf2386ba12e taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1490.079256] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-906c89a4-2b84-43c4-aec8-0bf2386ba12e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1490.079305] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-906c89a4-2b84-43c4-aec8-0bf2386ba12e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1490.079456] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-906c89a4-2b84-43c4-aec8-0bf2386ba12e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1490.079561] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('906c89a4-2b84-43c4-aec8-0bf2386ba12e',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1490.579788] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e5af3025-e700-40cd-be52-f7ebbf00239f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1490.580929] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 906c89a4-2b84-43c4-aec8-0bf2386ba12e with status ACTIVE [ 1490.581760] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1490.581760] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1490.581760] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1490.581760] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1490.581760] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1490.582094] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1490.582094] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1490.582094] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1490.582229] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1490.582229] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1490.582405] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1490.582494] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1490.582556] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1490.582694] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1490.582788] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1490.582839] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 906c89a4-2b84-43c4-aec8-0bf2386ba12e is going to be updated. [ 1490.584301] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5af3025-e700-40cd-be52-f7ebbf00239f taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1490.584392] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5af3025-e700-40cd-be52-f7ebbf00239f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1490.610521] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1490.610729] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1490.610729] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1490.610925] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1490.611079] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1490.611234] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-906c89a4-2b84-43c4-aec8-0bf2386ba12e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1491.085211] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e5af3025-e700-40cd-be52-f7ebbf00239f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1491.587592] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1491.587914] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1491.587914] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1491.588154] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1491.588284] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1491.588388] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5af3025-e700-40cd-be52-f7ebbf00239f is going to be created. [ 1491.612058] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1491.612250] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1491.612293] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1491.612557] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1491.612713] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1491.622669] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5af3025-e700-40cd-be52-f7ebbf00239f in Status: UNINITIALIZED for 2s [ 1493.635029] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5af3025-e700-40cd-be52-f7ebbf00239f in Status: SUCCESS [ 1493.635407] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5af3025-e700-40cd-be52-f7ebbf00239f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1493.635407] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5af3025-e700-40cd-be52-f7ebbf00239f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1493.635563] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5af3025-e700-40cd-be52-f7ebbf00239f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1493.635760] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1493.635905] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1493.635976] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1493.636125] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1493.636206] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1493.636292] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5af3025-e700-40cd-be52-f7ebbf00239f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1493.636381] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e5af3025-e700-40cd-be52-f7ebbf00239f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1494.138753] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e5af3025-e700-40cd-be52-f7ebbf00239f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1494.640994] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e5af3025-e700-40cd-be52-f7ebbf00239f: rpc.has_security_group_logging(os_id): False [ 1494.659731] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1494.659943] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1494.659943] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1494.660117] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1494.660215] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1494.660460] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1494.660561] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1494.660625] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1494.660778] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1494.660854] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1494.660942] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e5af3025-e700-40cd-be52-f7ebbf00239f is going to be created. [ 1494.720687] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1494.720941] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1494.720941] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1494.721156] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1494.721343] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1494.732742] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e5af3025-e700-40cd-be52-f7ebbf00239f in Status: IN_PROGRESS for 2s [ 1495.074651] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1495.074862] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1496.746693] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e5af3025-e700-40cd-be52-f7ebbf00239f in Status: SUCCESS [ 1496.747115] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e5af3025-e700-40cd-be52-f7ebbf00239f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1500.076424] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1500.076758] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1505.078246] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1505.078825] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1510.079978] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1510.080373] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1515.080698] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1515.081169] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1517.001348] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1517.001763] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1517.001763] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1517.001763] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1517.001875] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1517.504805] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1518.006838] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1518.509598] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1518.509703] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1519.313799] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1519.314248] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1519.314248] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1519.314350] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1519.328200] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1519.329230] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1519.330045] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1519.365896] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1519.366159] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1519.366159] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1519.366369] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1519.380648] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1519.381512] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1519.381601] env[65065]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65065) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1519.381685] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1519.414195] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1519.414432] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1519.414432] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1519.414590] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1519.415254] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1519.415400] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1519.484768] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1519.484963] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1519.485043] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1519.485294] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1519.485631] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1519.485905] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1519.560911] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1519.561129] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1519.561129] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1519.561374] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1519.561654] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1519.561906] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:22. [ 1519.561994] env[65065]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'6eb70570-d335-47e5-a771-3fc3c1b8cdf4', '6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e', 'a057519d-085e-4b14-acb1-755fbec909af', 'eb00c909-3649-4026-9f97-79b0f488a362', '4c1875d8-72c6-4298-b87e-1bda7f9214d3', '7d0941d4-57d8-45e9-9f2f-95128b8136e5', 'cc04914d-716e-49e1-8a77-946f904f69bb', '36b0a7bf-c185-47f8-9c6c-88ed66cc1f56', '5501386c-6d40-4911-b095-561660dd038b', '1e5f0086-b1e3-4f00-8207-8306f153d0e4', '6c6d05e2-e80c-477f-9eea-12f17d58d439', 'afe348a4-4bdc-4830-8b52-3584e5dee837', '386d96b4-ccad-4c04-8bda-534b3f25dc91', 'e2e5973c-5504-4cd5-9f92-77ba0193d841', 'e4ff6072-a232-4ebe-b049-2085dcef5991', 'e5af3025-e700-40cd-be52-f7ebbf00239f', '3197cfcc-1b3e-4ef1-a343-d5e39684c0d2', '4a714159-17dd-4324-93b8-81c81e256b0e', '99423afc-7fd3-4e3d-8a84-f190e0af048f', '1a8690bf-b436-47bf-abed-9ade6d6d5c3f', '4473193a-198b-4342-a9ef-a1966ddd9441', '1b329aa6-2b06-4112-ad10-7c2ede9e4774'} {{(pid=65065) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1519.562086] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1519.580863] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1519.581068] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1519.581068] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1519.581305] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1519.581397] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1519.581507] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1519.581583] env[65065]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65065) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1519.581656] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1519.657232] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1519.657499] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1519.657499] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1519.657642] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1519.658678] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1519.658911] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1519.658986] env[65065]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65065) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1519.659067] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1519.659135] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1519.659214] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/22 resources of Type:Security Group Rules [ 1519.659285] env[65065]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6eb70570-d335-47e5-a771-3fc3c1b8cdf4 with Priority: HIGH for action security_group_rules [ 1519.659364] env[65065]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e with Priority: HIGH for action security_group_rules [ 1519.659431] env[65065]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a057519d-085e-4b14-acb1-755fbec909af with Priority: HIGH for action security_group_rules [ 1519.659490] env[65065]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: eb00c909-3649-4026-9f97-79b0f488a362 with Priority: HIGH for action security_group_rules [ 1519.659551] env[65065]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4c1875d8-72c6-4298-b87e-1bda7f9214d3 with Priority: HIGH for action security_group_rules [ 1519.659613] env[65065]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 with Priority: HIGH for action security_group_rules [ 1519.659671] env[65065]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cc04914d-716e-49e1-8a77-946f904f69bb with Priority: HIGH for action security_group_rules [ 1519.659730] env[65065]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 36b0a7bf-c185-47f8-9c6c-88ed66cc1f56 with Priority: HIGH for action security_group_rules [ 1519.659789] env[65065]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5501386c-6d40-4911-b095-561660dd038b with Priority: HIGH for action security_group_rules [ 1519.659846] env[65065]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 with Priority: HIGH for action security_group_rules [ 1519.659895] env[65065]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6c6d05e2-e80c-477f-9eea-12f17d58d439 with Priority: HIGH for action security_group_rules [ 1519.659955] env[65065]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: afe348a4-4bdc-4830-8b52-3584e5dee837 with Priority: HIGH for action security_group_rules [ 1519.660021] env[65065]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 386d96b4-ccad-4c04-8bda-534b3f25dc91 with Priority: HIGH for action security_group_rules [ 1519.660080] env[65065]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e2e5973c-5504-4cd5-9f92-77ba0193d841 with Priority: HIGH for action security_group_rules [ 1519.660141] env[65065]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e4ff6072-a232-4ebe-b049-2085dcef5991 with Priority: HIGH for action security_group_rules [ 1519.660208] env[65065]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e5af3025-e700-40cd-be52-f7ebbf00239f with Priority: HIGH for action security_group_rules [ 1519.660258] env[65065]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3197cfcc-1b3e-4ef1-a343-d5e39684c0d2 with Priority: HIGH for action security_group_rules [ 1519.660307] env[65065]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4a714159-17dd-4324-93b8-81c81e256b0e with Priority: HIGH for action security_group_rules [ 1519.660356] env[65065]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 99423afc-7fd3-4e3d-8a84-f190e0af048f with Priority: HIGH for action security_group_rules [ 1519.660418] env[65065]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1a8690bf-b436-47bf-abed-9ade6d6d5c3f with Priority: HIGH for action security_group_rules [ 1519.660507] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1520.081600] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1520.081779] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=0 [ 1520.081976] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6eb70570-d335-47e5-a771-3fc3c1b8cdf4 with Priority: HIGH for action security_group_rules [ 1520.082199] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a057519d-085e-4b14-acb1-755fbec909af with Priority: HIGH for action security_group_rules [ 1520.082372] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc04914d-716e-49e1-8a77-946f904f69bb with Priority: HIGH for action security_group_rules [ 1520.082536] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4ff6072-a232-4ebe-b049-2085dcef5991 with Priority: HIGH for action security_group_rules [ 1520.082737] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a8690bf-b436-47bf-abed-9ade6d6d5c3f with Priority: HIGH for action security_group_rules [ 1520.082872] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99423afc-7fd3-4e3d-8a84-f190e0af048f with Priority: HIGH for action security_group_rules [ 1520.083047] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a714159-17dd-4324-93b8-81c81e256b0e with Priority: HIGH for action security_group_rules [ 1520.083229] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3197cfcc-1b3e-4ef1-a343-d5e39684c0d2 with Priority: HIGH for action security_group_rules [ 1520.083394] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2e5973c-5504-4cd5-9f92-77ba0193d841 with Priority: HIGH for action security_group_rules [ 1520.083550] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5af3025-e700-40cd-be52-f7ebbf00239f with Priority: HIGH for action security_group_rules [ 1520.083706] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 386d96b4-ccad-4c04-8bda-534b3f25dc91 with Priority: HIGH for action security_group_rules [ 1520.083864] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: afe348a4-4bdc-4830-8b52-3584e5dee837 with Priority: HIGH for action security_group_rules [ 1520.084037] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c6d05e2-e80c-477f-9eea-12f17d58d439 with Priority: HIGH for action security_group_rules [ 1520.084196] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 with Priority: HIGH for action security_group_rules [ 1520.084349] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5501386c-6d40-4911-b095-561660dd038b with Priority: HIGH for action security_group_rules [ 1520.084498] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 with Priority: HIGH for action security_group_rules [ 1520.084652] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 36b0a7bf-c185-47f8-9c6c-88ed66cc1f56 with Priority: HIGH for action security_group_rules [ 1520.084806] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c1875d8-72c6-4298-b87e-1bda7f9214d3 with Priority: HIGH for action security_group_rules [ 1520.084962] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e with Priority: HIGH for action security_group_rules [ 1520.085146] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb00c909-3649-4026-9f97-79b0f488a362 with Priority: HIGH for action security_group_rules [ 1520.085633] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6eb70570-d335-47e5-a771-3fc3c1b8cdf4 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1520.085828] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6eb70570-d335-47e5-a771-3fc3c1b8cdf4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1520.085935] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6eb70570-d335-47e5-a771-3fc3c1b8cdf4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1520.086280] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6eb70570-d335-47e5-a771-3fc3c1b8cdf4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1520.086411] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6eb70570-d335-47e5-a771-3fc3c1b8cdf4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1520.087678] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a057519d-085e-4b14-acb1-755fbec909af taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1520.088325] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a057519d-085e-4b14-acb1-755fbec909af" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1520.088470] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a057519d-085e-4b14-acb1-755fbec909af" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1520.088731] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a057519d-085e-4b14-acb1-755fbec909af" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1520.089015] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a057519d-085e-4b14-acb1-755fbec909af',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1520.090104] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cc04914d-716e-49e1-8a77-946f904f69bb taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1520.090834] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cc04914d-716e-49e1-8a77-946f904f69bb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1520.090944] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cc04914d-716e-49e1-8a77-946f904f69bb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1520.091192] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cc04914d-716e-49e1-8a77-946f904f69bb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1520.091311] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cc04914d-716e-49e1-8a77-946f904f69bb',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1520.092744] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e4ff6072-a232-4ebe-b049-2085dcef5991 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1520.092912] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e4ff6072-a232-4ebe-b049-2085dcef5991" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1520.092912] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e4ff6072-a232-4ebe-b049-2085dcef5991" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1520.093249] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e4ff6072-a232-4ebe-b049-2085dcef5991" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1520.093249] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e4ff6072-a232-4ebe-b049-2085dcef5991',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1520.093980] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1a8690bf-b436-47bf-abed-9ade6d6d5c3f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1520.093980] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1a8690bf-b436-47bf-abed-9ade6d6d5c3f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1520.093980] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1a8690bf-b436-47bf-abed-9ade6d6d5c3f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1520.094244] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1a8690bf-b436-47bf-abed-9ade6d6d5c3f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1520.094244] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1a8690bf-b436-47bf-abed-9ade6d6d5c3f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1520.095079] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-99423afc-7fd3-4e3d-8a84-f190e0af048f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1520.095079] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1520.095079] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1520.095757] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1520.095757] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('99423afc-7fd3-4e3d-8a84-f190e0af048f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1520.096223] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4a714159-17dd-4324-93b8-81c81e256b0e taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1520.096223] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4a714159-17dd-4324-93b8-81c81e256b0e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1520.096223] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4a714159-17dd-4324-93b8-81c81e256b0e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1520.096463] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4a714159-17dd-4324-93b8-81c81e256b0e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1520.096463] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4a714159-17dd-4324-93b8-81c81e256b0e',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1520.097210] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3197cfcc-1b3e-4ef1-a343-d5e39684c0d2 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1520.097326] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3197cfcc-1b3e-4ef1-a343-d5e39684c0d2" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1520.097326] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3197cfcc-1b3e-4ef1-a343-d5e39684c0d2" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1520.097466] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3197cfcc-1b3e-4ef1-a343-d5e39684c0d2" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1520.097538] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3197cfcc-1b3e-4ef1-a343-d5e39684c0d2',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1520.098220] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e2e5973c-5504-4cd5-9f92-77ba0193d841 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1520.098380] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1520.098380] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1520.098960] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1520.098960] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e2e5973c-5504-4cd5-9f92-77ba0193d841',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1520.099275] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e5af3025-e700-40cd-be52-f7ebbf00239f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1520.099407] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e5af3025-e700-40cd-be52-f7ebbf00239f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1520.099843] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e5af3025-e700-40cd-be52-f7ebbf00239f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1520.099843] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e5af3025-e700-40cd-be52-f7ebbf00239f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1520.099843] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e5af3025-e700-40cd-be52-f7ebbf00239f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1520.100415] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-386d96b4-ccad-4c04-8bda-534b3f25dc91 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1520.100517] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-386d96b4-ccad-4c04-8bda-534b3f25dc91" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1520.100578] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-386d96b4-ccad-4c04-8bda-534b3f25dc91" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1520.100725] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-386d96b4-ccad-4c04-8bda-534b3f25dc91" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1520.100856] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('386d96b4-ccad-4c04-8bda-534b3f25dc91',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1520.101470] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-afe348a4-4bdc-4830-8b52-3584e5dee837 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1520.101570] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-afe348a4-4bdc-4830-8b52-3584e5dee837" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1520.101704] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-afe348a4-4bdc-4830-8b52-3584e5dee837" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1520.102163] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-afe348a4-4bdc-4830-8b52-3584e5dee837" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1520.102163] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('afe348a4-4bdc-4830-8b52-3584e5dee837',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1520.102546] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6c6d05e2-e80c-477f-9eea-12f17d58d439 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1520.102653] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6c6d05e2-e80c-477f-9eea-12f17d58d439" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1520.102712] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6c6d05e2-e80c-477f-9eea-12f17d58d439" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1520.103093] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6c6d05e2-e80c-477f-9eea-12f17d58d439" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1520.103093] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6c6d05e2-e80c-477f-9eea-12f17d58d439',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1520.103590] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1e5f0086-b1e3-4f00-8207-8306f153d0e4 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1520.103697] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1520.103777] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1520.103899] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1520.103970] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1e5f0086-b1e3-4f00-8207-8306f153d0e4',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1520.104748] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5501386c-6d40-4911-b095-561660dd038b taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1520.104870] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5501386c-6d40-4911-b095-561660dd038b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1520.104933] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5501386c-6d40-4911-b095-561660dd038b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1520.105058] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5501386c-6d40-4911-b095-561660dd038b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1520.105439] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5501386c-6d40-4911-b095-561660dd038b',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1520.105790] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7d0941d4-57d8-45e9-9f2f-95128b8136e5 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1520.106177] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1520.106177] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1520.106177] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1520.106177] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7d0941d4-57d8-45e9-9f2f-95128b8136e5',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1520.107078] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-36b0a7bf-c185-47f8-9c6c-88ed66cc1f56 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1520.107078] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-36b0a7bf-c185-47f8-9c6c-88ed66cc1f56" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1520.107078] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-36b0a7bf-c185-47f8-9c6c-88ed66cc1f56" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1520.107313] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-36b0a7bf-c185-47f8-9c6c-88ed66cc1f56" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1520.107313] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('36b0a7bf-c185-47f8-9c6c-88ed66cc1f56',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1520.107968] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4c1875d8-72c6-4298-b87e-1bda7f9214d3 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1520.108080] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4c1875d8-72c6-4298-b87e-1bda7f9214d3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1520.108143] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4c1875d8-72c6-4298-b87e-1bda7f9214d3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1520.108284] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4c1875d8-72c6-4298-b87e-1bda7f9214d3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1520.108600] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4c1875d8-72c6-4298-b87e-1bda7f9214d3',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1520.109017] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1520.109154] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1520.109320] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1520.109320] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1520.109417] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1520.110141] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eb00c909-3649-4026-9f97-79b0f488a362 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1520.110141] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eb00c909-3649-4026-9f97-79b0f488a362" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1520.110337] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eb00c909-3649-4026-9f97-79b0f488a362" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1520.110337] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eb00c909-3649-4026-9f97-79b0f488a362" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1520.110441] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eb00c909-3649-4026-9f97-79b0f488a362',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1520.142743] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1520.142743] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1520.142743] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1520.142743] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1520.144842] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1520.144943] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1520.175787] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1520.175946] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6eb70570-d335-47e5-a771-3fc3c1b8cdf4 is going to be deleted. [ 1520.176808] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1520.177041] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1520.193776] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1520.193960] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e4ff6072-a232-4ebe-b049-2085dcef5991 is going to be deleted. [ 1520.253653] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1520.253918] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1520.253918] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1520.254051] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1520.254105] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1520.254228] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6eb70570-d335-47e5-a771-3fc3c1b8cdf4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1520.254946] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1520.255070] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1520.255205] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1520.255323] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1520.255407] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1520.255513] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e4ff6072-a232-4ebe-b049-2085dcef5991" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1520.623188] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5af3025-e700-40cd-be52-f7ebbf00239f taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1520.623649] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5af3025-e700-40cd-be52-f7ebbf00239f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1520.623649] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5af3025-e700-40cd-be52-f7ebbf00239f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1520.623789] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5af3025-e700-40cd-be52-f7ebbf00239f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1520.623868] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1520.623963] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1520.624034] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1520.624200] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1520.624281] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1520.624350] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5af3025-e700-40cd-be52-f7ebbf00239f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1520.624433] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e5af3025-e700-40cd-be52-f7ebbf00239f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1520.666442] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1520.666744] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1520.666744] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1520.666939] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1520.696848] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1520.697113] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1520.697916] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1520.698039] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1520.698798] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1520.698890] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1520.699621] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1520.699727] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1520.700415] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1520.700505] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1520.701333] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1520.701450] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1520.702212] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1520.702294] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1520.703007] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1520.703104] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1520.703807] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1520.703900] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1520.704600] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1520.704689] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1520.705298] env[65065]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1520.705760] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1520.705861] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1520.706531] env[65065]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1520.706960] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1520.707084] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1520.707641] env[65065]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1520.708077] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1520.708175] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1520.708917] env[65065]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1520.709339] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1520.709441] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1520.710141] env[65065]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1520.710625] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1520.710709] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1520.711385] env[65065]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1520.711824] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1520.711936] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cc04914d-716e-49e1-8a77-946f904f69bb is going to be deleted. [ 1520.713505] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1520.713585] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1520.713674] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1520.713922] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1520.731916] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1520.732101] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a057519d-085e-4b14-acb1-755fbec909af is going to be deleted. [ 1520.732962] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1520.733191] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1520.766654] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1520.766846] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1520.767600] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1520.767710] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 386d96b4-ccad-4c04-8bda-534b3f25dc91 is going to be deleted. [ 1520.768622] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1520.768852] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1520.791195] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1520.791356] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e is going to be deleted. [ 1520.792390] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1520.792679] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1520.794209] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1520.794315] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1520.824094] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1520.824271] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e2e5973c-5504-4cd5-9f92-77ba0193d841 is going to be deleted. [ 1520.825322] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1520.825322] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1520.894202] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1520.894436] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1a8690bf-b436-47bf-abed-9ade6d6d5c3f is going to be deleted. [ 1520.895264] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1520.895492] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1520.897349] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1520.897488] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1520.899167] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1520.899292] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1520.951842] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1520.952040] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 99423afc-7fd3-4e3d-8a84-f190e0af048f is going to be deleted. [ 1520.952997] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1520.953248] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1521.048276] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1521.048497] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1521.072230] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1521.072433] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: afe348a4-4bdc-4830-8b52-3584e5dee837 is going to be deleted. [ 1521.073311] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1521.073533] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1521.083147] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1521.083387] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1521.136864] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e5af3025-e700-40cd-be52-f7ebbf00239f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1521.167139] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1521.167377] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eb00c909-3649-4026-9f97-79b0f488a362 is going to be deleted. [ 1521.168606] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1521.168892] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1521.225140] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1521.225372] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6c6d05e2-e80c-477f-9eea-12f17d58d439 is going to be deleted. [ 1521.226383] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1521.226614] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1521.261137] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1521.261398] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1521.266396] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1521.266600] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1521.301637] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1521.301813] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3197cfcc-1b3e-4ef1-a343-d5e39684c0d2 is going to be deleted. [ 1521.302769] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1521.302994] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1521.341819] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1521.342044] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5501386c-6d40-4911-b095-561660dd038b is going to be deleted. [ 1521.343094] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1521.343361] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1521.395864] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1521.396062] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1e5f0086-b1e3-4f00-8207-8306f153d0e4 is going to be deleted. [ 1521.397455] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1521.397753] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1521.432216] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1521.432432] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1521.441533] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1521.441735] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1521.451120] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1521.451348] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4a714159-17dd-4324-93b8-81c81e256b0e is going to be deleted. [ 1521.452735] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1521.453079] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1521.455165] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1521.455383] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1521.540214] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1521.540350] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 36b0a7bf-c185-47f8-9c6c-88ed66cc1f56 is going to be deleted. [ 1521.541275] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1521.541497] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1521.590420] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1521.590629] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1521.632969] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1521.632969] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1521.639114] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1521.639349] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1521.639446] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e5af3025-e700-40cd-be52-f7ebbf00239f: rpc.has_security_group_logging(os_id): False [ 1521.671372] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1521.671563] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7d0941d4-57d8-45e9-9f2f-95128b8136e5 is going to be deleted. [ 1521.672655] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1521.672908] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1521.697577] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1521.697823] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1521.767934] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1521.768169] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4c1875d8-72c6-4298-b87e-1bda7f9214d3 is going to be deleted. [ 1521.769015] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1521.769247] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1521.769342] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1521.769462] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cc04914d-716e-49e1-8a77-946f904f69bb" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1521.769639] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1521.769799] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1521.769878] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1521.769990] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a057519d-085e-4b14-acb1-755fbec909af" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1521.770555] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1521.770744] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1521.770831] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1521.770969] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6fadab4e-48c8-49d4-99a3-f7d1c72f9f6e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1521.771151] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1521.771307] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1521.771378] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1521.771487] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-386d96b4-ccad-4c04-8bda-534b3f25dc91" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1521.771613] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1521.771751] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1521.771824] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1521.771934] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e2e5973c-5504-4cd5-9f92-77ba0193d841" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1521.772081] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1521.772217] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1521.772289] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1521.772397] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1a8690bf-b436-47bf-abed-9ade6d6d5c3f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1521.772519] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1521.772654] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1521.772725] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1521.772833] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-afe348a4-4bdc-4830-8b52-3584e5dee837" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1521.772953] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1521.773102] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1521.773175] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1521.773282] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-99423afc-7fd3-4e3d-8a84-f190e0af048f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1521.773404] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1521.773537] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1521.773610] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1521.773711] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6c6d05e2-e80c-477f-9eea-12f17d58d439" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1521.773829] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1521.773961] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1521.774067] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1521.774210] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eb00c909-3649-4026-9f97-79b0f488a362" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1521.774340] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1521.774478] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1521.774550] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1521.774655] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3197cfcc-1b3e-4ef1-a343-d5e39684c0d2" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1521.774776] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1521.774910] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1521.774981] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1521.775101] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1e5f0086-b1e3-4f00-8207-8306f153d0e4" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1521.775221] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1521.775355] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1521.775426] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1521.775534] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5501386c-6d40-4911-b095-561660dd038b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1521.775658] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1521.775793] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1521.775866] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1521.775976] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4a714159-17dd-4324-93b8-81c81e256b0e" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1521.776126] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1521.776271] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1521.828492] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1521.828707] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1521.847699] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1521.847992] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1521.848106] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1521.848179] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1521.848388] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1521.848472] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1521.848557] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e5af3025-e700-40cd-be52-f7ebbf00239f is going to be updated. [ 1521.849663] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1521.849834] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1521.849920] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1521.850049] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-36b0a7bf-c185-47f8-9c6c-88ed66cc1f56" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1521.903025] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1521.903274] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1521.903274] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1521.903439] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1521.903533] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1521.903652] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7d0941d4-57d8-45e9-9f2f-95128b8136e5" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.004646] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.004855] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.004855] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.005086] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.005211] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.005345] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4c1875d8-72c6-4298-b87e-1bda7f9214d3" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.026626] env[65065]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1522.027298] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.027421] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.027539] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.027766] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.027912] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.061214] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e5af3025-e700-40cd-be52-f7ebbf00239f in Status: IN_PROGRESS for 2s [ 1524.077641] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e5af3025-e700-40cd-be52-f7ebbf00239f in Status: SUCCESS [ 1524.078054] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e5af3025-e700-40cd-be52-f7ebbf00239f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1525.086350] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1525.086747] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1530.087517] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1530.087908] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1535.088775] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1535.089043] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1540.090220] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1540.090584] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1545.091576] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1545.091824] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1550.092758] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1550.093190] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1555.093781] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1555.094229] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1560.094626] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1560.095054] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1565.095270] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1565.095708] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1565.677785] env[65065]: INFO networking_nsxv3.common.synchronization [req-54bde7ce-4730-4082-9b80-315b010043d9 req-37fca947-0058-43e0-a521-95602a96cb90 tempest-AttachVolumeTestJSON-207450638 tempest-AttachVolumeTestJSON-207450638-project-member] Enqueued Resource ID: e5af3025-e700-40cd-be52-f7ebbf00239f with Priority: HIGHEST for action security_group_members [ 1565.678346] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5af3025-e700-40cd-be52-f7ebbf00239f with Priority: HIGHEST for action security_group_members [ 1565.678653] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5af3025-e700-40cd-be52-f7ebbf00239f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1565.678801] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5af3025-e700-40cd-be52-f7ebbf00239f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1565.678857] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5af3025-e700-40cd-be52-f7ebbf00239f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1565.679165] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5af3025-e700-40cd-be52-f7ebbf00239f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1565.679330] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1565.679430] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1565.679494] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1565.679647] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1565.679733] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1565.679872] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e5af3025-e700-40cd-be52-f7ebbf00239f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1566.182520] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1566.182903] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1566.182903] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1566.182979] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1566.183100] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1566.183280] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1566.183376] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1566.183436] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1566.183587] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1566.183665] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1566.183748] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5af3025-e700-40cd-be52-f7ebbf00239f is going to be updated. [ 1566.215819] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1566.216106] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1566.216106] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1566.216231] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1566.216370] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1566.224922] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5af3025-e700-40cd-be52-f7ebbf00239f in Status: IN_PROGRESS for 2s [ 1568.237730] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5af3025-e700-40cd-be52-f7ebbf00239f in Status: SUCCESS [ 1568.237730] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5af3025-e700-40cd-be52-f7ebbf00239f deletion is rescheduled due to dependency. [ 1568.237730] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5af3025-e700-40cd-be52-f7ebbf00239f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1570.678919] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1570.679475] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1575.679721] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1575.680186] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1580.680720] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1580.681041] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1583.616673] env[65065]: INFO networking_nsxv3.common.synchronization [None req-23074f9a-ab9a-48ea-9db4-ed27b736efb0 None None] Enqueued Resource ID: c8fd93d3-3302-44ac-ae31-9b2308ba5080 with Priority: HIGHEST for action port [ 1583.617252] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8fd93d3-3302-44ac-ae31-9b2308ba5080 with Priority: HIGHEST for action port [ 1583.617562] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-c8fd93d3-3302-44ac-ae31-9b2308ba5080 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1583.617682] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c8fd93d3-3302-44ac-ae31-9b2308ba5080" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1583.617769] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c8fd93d3-3302-44ac-ae31-9b2308ba5080" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1583.618143] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c8fd93d3-3302-44ac-ae31-9b2308ba5080" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1583.618227] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c8fd93d3-3302-44ac-ae31-9b2308ba5080',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1584.121536] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c8fd93d3-3302-44ac-ae31-9b2308ba5080 [ 1584.121828] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1584.121991] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1584.122073] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1584.122329] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1584.122444] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1584.122540] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c8fd93d3-3302-44ac-ae31-9b2308ba5080 already deleted. [ 1584.122621] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c8fd93d3-3302-44ac-ae31-9b2308ba5080" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1584.398685] env[65065]: INFO networking_nsxv3.common.synchronization [None req-b25701f1-c2d2-4504-94cd-613e143bdd07 tempest-AttachVolumeNegativeTest-1821271617 tempest-AttachVolumeNegativeTest-1821271617-project-member] Enqueued Resource ID: bed648a2-307f-4d71-be6f-9c8512f84242 with Priority: HIGHEST for action security_group_rules [ 1584.399185] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bed648a2-307f-4d71-be6f-9c8512f84242 with Priority: HIGHEST for action security_group_rules [ 1584.399482] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bed648a2-307f-4d71-be6f-9c8512f84242 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1584.399602] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bed648a2-307f-4d71-be6f-9c8512f84242" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1584.399670] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bed648a2-307f-4d71-be6f-9c8512f84242" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1584.400220] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bed648a2-307f-4d71-be6f-9c8512f84242" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1584.400220] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bed648a2-307f-4d71-be6f-9c8512f84242',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1584.481024] env[65065]: INFO networking_nsxv3.common.synchronization [None req-06a977e5-2fd4-46b0-bc90-ff73e2644299 tempest-AttachVolumeNegativeTest-1821271617 tempest-AttachVolumeNegativeTest-1821271617-project-member] Enqueued Resource ID: bed648a2-307f-4d71-be6f-9c8512f84242 with Priority: HIGHEST for action security_group_rules [ 1584.481532] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bed648a2-307f-4d71-be6f-9c8512f84242 with Priority: HIGHEST for action security_group_rules [ 1584.481842] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bed648a2-307f-4d71-be6f-9c8512f84242 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1584.481957] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bed648a2-307f-4d71-be6f-9c8512f84242" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1584.920878] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1584.921192] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1584.921192] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1584.921376] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1584.921466] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1584.921557] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bed648a2-307f-4d71-be6f-9c8512f84242 already deleted. [ 1584.921638] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bed648a2-307f-4d71-be6f-9c8512f84242" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1584.921786] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bed648a2-307f-4d71-be6f-9c8512f84242" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1584.921930] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bed648a2-307f-4d71-be6f-9c8512f84242" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1584.922016] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bed648a2-307f-4d71-be6f-9c8512f84242',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1585.117934] env[65065]: INFO networking_nsxv3.common.synchronization [None req-43f231f5-52c1-4588-8371-ed1fb2ea0b77 None None] Enqueued Resource ID: 1da06540-fd4b-466c-8cf5-726e861f90ef with Priority: HIGHEST for action port [ 1585.118492] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1da06540-fd4b-466c-8cf5-726e861f90ef with Priority: HIGHEST for action port [ 1585.118756] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-1da06540-fd4b-466c-8cf5-726e861f90ef taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1585.118875] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1da06540-fd4b-466c-8cf5-726e861f90ef" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1585.118996] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1da06540-fd4b-466c-8cf5-726e861f90ef" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1585.119198] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1da06540-fd4b-466c-8cf5-726e861f90ef" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1585.119278] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1da06540-fd4b-466c-8cf5-726e861f90ef',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1585.442452] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1585.442707] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1585.442707] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1585.442907] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1585.443009] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1585.443110] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bed648a2-307f-4d71-be6f-9c8512f84242 already deleted. [ 1585.443191] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bed648a2-307f-4d71-be6f-9c8512f84242" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1585.621326] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1da06540-fd4b-466c-8cf5-726e861f90ef [ 1585.621902] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1585.621902] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1585.621902] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1585.622094] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1585.622094] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1585.622150] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1da06540-fd4b-466c-8cf5-726e861f90ef already deleted. [ 1585.622213] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1da06540-fd4b-466c-8cf5-726e861f90ef" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1589.818553] env[65065]: INFO networking_nsxv3.common.synchronization [req-95bf678d-85fd-402c-a07f-7a322158a4f5 req-80c28ed9-a0aa-4d8b-9be8-9c2d87cbef5e tempest-AttachVolumeNegativeTest-1821271617 tempest-AttachVolumeNegativeTest-1821271617-project-member] Enqueued Resource ID: bed648a2-307f-4d71-be6f-9c8512f84242 with Priority: HIGHEST for action security_group_members [ 1589.819125] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bed648a2-307f-4d71-be6f-9c8512f84242 with Priority: HIGHEST for action security_group_members [ 1589.819446] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-bed648a2-307f-4d71-be6f-9c8512f84242 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1589.819568] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bed648a2-307f-4d71-be6f-9c8512f84242" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1589.819631] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bed648a2-307f-4d71-be6f-9c8512f84242" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1589.819879] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bed648a2-307f-4d71-be6f-9c8512f84242" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1589.820118] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1589.820236] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1589.820300] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1589.820600] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1589.820600] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1589.820702] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bed648a2-307f-4d71-be6f-9c8512f84242',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1590.097955] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock network-657 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1590.098177] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "network-657" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1590.098300] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "network-657" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1590.098638] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "network-657" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1590.098890] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1590.099049] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1590.099164] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1590.099371] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1590.099508] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1590.099730] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1590.099839] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1590.099943] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1590.100058] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1590.100162] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1590.100262] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1590.100387] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1590.121352] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1590.121504] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1590.121637] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1590.121801] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "network-657" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1590.122142] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock port-b0177c44-dfe4-4498-bbdd-1ba2c5334e66 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1590.122308] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "port-b0177c44-dfe4-4498-bbdd-1ba2c5334e66" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1590.122426] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "port-b0177c44-dfe4-4498-bbdd-1ba2c5334e66" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1590.122716] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "port-b0177c44-dfe4-4498-bbdd-1ba2c5334e66" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1590.122868] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b0177c44-dfe4-4498-bbdd-1ba2c5334e66',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1590.323712] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1590.323918] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1590.323918] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1590.324109] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1590.324198] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1590.324398] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1590.324493] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1590.324555] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1590.324753] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1590.324839] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1590.324926] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bed648a2-307f-4d71-be6f-9c8512f84242 already deleted. [ 1590.325013] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bed648a2-307f-4d71-be6f-9c8512f84242" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1590.625366] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1590.625618] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1590.625742] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1590.626050] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1590.626204] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1590.626389] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Segment Port b0177c44-dfe4-4498-bbdd-1ba2c5334e66 not found, creating... [ 1590.626665] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1590.626845] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1590.626963] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1590.627322] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1590.627322] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1590.627645] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1590.627800] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1590.627915] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1590.628148] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1590.628280] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1590.628416] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Resource: SegmentPort with ID: b0177c44-dfe4-4498-bbdd-1ba2c5334e66 is going to be created. [ 1590.652452] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1590.652727] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1590.652782] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1590.653120] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1590.653535] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1590.653786] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "port-b0177c44-dfe4-4498-bbdd-1ba2c5334e66" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1591.344991] env[65065]: INFO networking_nsxv3.common.synchronization [req-95bf678d-85fd-402c-a07f-7a322158a4f5 req-1de06057-266c-49de-b1e5-017f76506e34 service nova] Enqueued Resource ID: bed648a2-307f-4d71-be6f-9c8512f84242 with Priority: HIGHEST for action security_group_rules [ 1591.345350] env[65065]: INFO networking_nsxv3.common.synchronization [req-95bf678d-85fd-402c-a07f-7a322158a4f5 req-1de06057-266c-49de-b1e5-017f76506e34 service nova] Enqueued Resource ID: bed648a2-307f-4d71-be6f-9c8512f84242 with Priority: HIGHEST for action security_group_members [ 1591.345350] env[65065]: INFO networking_nsxv3.common.synchronization [req-95bf678d-85fd-402c-a07f-7a322158a4f5 req-1de06057-266c-49de-b1e5-017f76506e34 service nova] Enqueued Resource ID: b0177c44-dfe4-4498-bbdd-1ba2c5334e66 with Priority: HIGHEST for action port [ 1591.345546] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bed648a2-307f-4d71-be6f-9c8512f84242 with Priority: HIGHEST for action security_group_rules [ 1591.345670] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bed648a2-307f-4d71-be6f-9c8512f84242 with Priority: HIGHEST for action security_group_members [ 1591.345778] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0177c44-dfe4-4498-bbdd-1ba2c5334e66 with Priority: HIGHEST for action port [ 1591.346493] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bed648a2-307f-4d71-be6f-9c8512f84242 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1591.346663] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bed648a2-307f-4d71-be6f-9c8512f84242" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1591.346864] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bed648a2-307f-4d71-be6f-9c8512f84242" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1591.347125] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bed648a2-307f-4d71-be6f-9c8512f84242" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1591.347257] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bed648a2-307f-4d71-be6f-9c8512f84242',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1591.348667] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-bed648a2-307f-4d71-be6f-9c8512f84242 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1591.348972] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bed648a2-307f-4d71-be6f-9c8512f84242" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1591.349125] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bed648a2-307f-4d71-be6f-9c8512f84242" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1591.349351] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bed648a2-307f-4d71-be6f-9c8512f84242" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1591.349615] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1591.349771] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1591.349876] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1591.350080] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1591.350216] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1591.351389] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bed648a2-307f-4d71-be6f-9c8512f84242',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1591.351706] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-b0177c44-dfe4-4498-bbdd-1ba2c5334e66 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1591.351864] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b0177c44-dfe4-4498-bbdd-1ba2c5334e66" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1591.351969] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b0177c44-dfe4-4498-bbdd-1ba2c5334e66" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1591.352377] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b0177c44-dfe4-4498-bbdd-1ba2c5334e66" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1591.352377] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b0177c44-dfe4-4498-bbdd-1ba2c5334e66',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1591.855140] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-bed648a2-307f-4d71-be6f-9c8512f84242 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1591.855272] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bed648a2-307f-4d71-be6f-9c8512f84242" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1591.855463] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bed648a2-307f-4d71-be6f-9c8512f84242',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1591.856371] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b0177c44-dfe4-4498-bbdd-1ba2c5334e66 with status ACTIVE [ 1591.856562] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1591.856677] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1591.856757] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1591.856956] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1591.857059] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1591.857233] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1591.857836] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1591.857836] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1591.857836] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1591.857836] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1591.857836] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1591.858086] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1591.858086] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1591.858086] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1591.858179] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1591.858209] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b0177c44-dfe4-4498-bbdd-1ba2c5334e66 is going to be updated. [ 1591.878847] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1591.879057] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1591.879057] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1591.879242] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1591.879374] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1591.879529] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b0177c44-dfe4-4498-bbdd-1ba2c5334e66" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1592.360221] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bed648a2-307f-4d71-be6f-9c8512f84242',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1592.862261] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1592.862562] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1592.862676] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1592.862956] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1592.863118] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1592.863237] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bed648a2-307f-4d71-be6f-9c8512f84242 is going to be created. [ 1592.893101] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1592.893476] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1592.893476] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1592.893673] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1592.893875] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1592.902606] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bed648a2-307f-4d71-be6f-9c8512f84242 in Status: UNINITIALIZED for 2s [ 1594.912699] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bed648a2-307f-4d71-be6f-9c8512f84242 in Status: SUCCESS [ 1594.913081] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bed648a2-307f-4d71-be6f-9c8512f84242" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1594.913081] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bed648a2-307f-4d71-be6f-9c8512f84242" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1594.913235] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bed648a2-307f-4d71-be6f-9c8512f84242" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1594.913426] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1594.913546] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1594.913611] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1594.913761] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1594.913842] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1594.913927] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bed648a2-307f-4d71-be6f-9c8512f84242" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1594.914029] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bed648a2-307f-4d71-be6f-9c8512f84242',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1595.416787] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bed648a2-307f-4d71-be6f-9c8512f84242',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1595.918977] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bed648a2-307f-4d71-be6f-9c8512f84242: rpc.has_security_group_logging(os_id): False [ 1595.936654] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1595.936866] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1595.936866] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1595.937109] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1595.937198] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1595.937437] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1595.937536] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1595.937598] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1595.937760] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1595.937863] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1595.937950] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bed648a2-307f-4d71-be6f-9c8512f84242 is going to be created. [ 1595.996252] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1595.996472] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1595.996472] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1595.996662] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1595.996883] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1596.006238] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bed648a2-307f-4d71-be6f-9c8512f84242 in Status: IN_PROGRESS for 2s [ 1596.347236] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1596.347433] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1598.019392] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bed648a2-307f-4d71-be6f-9c8512f84242 in Status: SUCCESS [ 1598.019809] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bed648a2-307f-4d71-be6f-9c8512f84242" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1601.348280] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1601.348654] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1606.349683] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1606.350116] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1611.350344] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1611.350705] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1616.351291] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1616.351640] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1621.352374] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1621.352801] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1626.353545] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1626.353998] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1631.355096] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1631.355776] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1636.356621] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1636.356990] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1641.358290] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1641.358744] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1646.360119] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1646.360469] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1647.013505] env[65065]: INFO networking_nsxv3.common.synchronization [None req-a02a765d-0fdf-4a64-9d0b-c8ca3a5cbdb8 tempest-AttachVolumeNegativeTest-1821271617 tempest-AttachVolumeNegativeTest-1821271617-project-member] Enqueued Resource ID: 5324b736-ef77-4a39-84e7-46739e2bcd2b with Priority: HIGHEST for action security_group_rules [ 1647.014169] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5324b736-ef77-4a39-84e7-46739e2bcd2b with Priority: HIGHEST for action security_group_rules [ 1647.014524] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5324b736-ef77-4a39-84e7-46739e2bcd2b taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1647.014675] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5324b736-ef77-4a39-84e7-46739e2bcd2b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1647.014762] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5324b736-ef77-4a39-84e7-46739e2bcd2b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1647.015052] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5324b736-ef77-4a39-84e7-46739e2bcd2b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1647.015164] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5324b736-ef77-4a39-84e7-46739e2bcd2b',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1647.092080] env[65065]: INFO networking_nsxv3.common.synchronization [None req-8e885abc-dae8-4e3d-afc1-fdfa5e4babbe tempest-AttachVolumeNegativeTest-1821271617 tempest-AttachVolumeNegativeTest-1821271617-project-member] Enqueued Resource ID: 5324b736-ef77-4a39-84e7-46739e2bcd2b with Priority: HIGHEST for action security_group_rules [ 1647.092553] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5324b736-ef77-4a39-84e7-46739e2bcd2b with Priority: HIGHEST for action security_group_rules [ 1647.093130] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5324b736-ef77-4a39-84e7-46739e2bcd2b taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1647.093239] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5324b736-ef77-4a39-84e7-46739e2bcd2b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1647.535712] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1647.536197] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1647.536197] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1647.536197] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1647.536385] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1647.536385] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5324b736-ef77-4a39-84e7-46739e2bcd2b already deleted. [ 1647.536459] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5324b736-ef77-4a39-84e7-46739e2bcd2b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1647.536548] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5324b736-ef77-4a39-84e7-46739e2bcd2b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1647.536705] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5324b736-ef77-4a39-84e7-46739e2bcd2b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1647.536787] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5324b736-ef77-4a39-84e7-46739e2bcd2b',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1648.064695] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1648.064893] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1648.064893] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1648.065042] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1648.065152] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1648.065255] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5324b736-ef77-4a39-84e7-46739e2bcd2b already deleted. [ 1648.065339] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5324b736-ef77-4a39-84e7-46739e2bcd2b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1652.093560] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1652.093856] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1652.376458] env[65065]: INFO networking_nsxv3.common.synchronization [req-d0bb5aea-8859-4797-8066-351798a85c2d req-f8ece3ab-61cf-469f-82b0-ffd48293a3df tempest-AttachVolumeNegativeTest-1821271617 tempest-AttachVolumeNegativeTest-1821271617-project-member] Enqueued Resource ID: 5324b736-ef77-4a39-84e7-46739e2bcd2b with Priority: HIGHEST for action security_group_members [ 1652.376512] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5324b736-ef77-4a39-84e7-46739e2bcd2b with Priority: HIGHEST for action security_group_members [ 1652.376790] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-5324b736-ef77-4a39-84e7-46739e2bcd2b taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1652.376912] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5324b736-ef77-4a39-84e7-46739e2bcd2b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1652.376977] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5324b736-ef77-4a39-84e7-46739e2bcd2b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1652.377279] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5324b736-ef77-4a39-84e7-46739e2bcd2b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1652.377427] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1652.377528] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1652.377591] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1652.377785] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1652.377832] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1652.377912] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5324b736-ef77-4a39-84e7-46739e2bcd2b',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1652.632260] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock network-657 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1652.632461] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "network-657" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1652.632585] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "network-657" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1652.632856] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "network-657" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1652.633119] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1652.633276] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1652.633393] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1652.633602] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1652.633766] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1652.633974] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1652.634096] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1652.634204] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1652.634311] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1652.634420] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1652.634525] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1652.634654] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1652.659338] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1652.659553] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1652.659662] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1652.659840] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "network-657" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1652.660168] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock port-d003817b-991f-475a-82b9-bb26d061ef69 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1652.660341] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "port-d003817b-991f-475a-82b9-bb26d061ef69" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1652.660459] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "port-d003817b-991f-475a-82b9-bb26d061ef69" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1652.660785] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "port-d003817b-991f-475a-82b9-bb26d061ef69" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1652.660925] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d003817b-991f-475a-82b9-bb26d061ef69',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1652.880486] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1652.880720] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1652.880720] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1652.880921] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1652.881023] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1652.881223] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1652.881325] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1652.881387] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1652.881537] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1652.881609] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1652.881693] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5324b736-ef77-4a39-84e7-46739e2bcd2b already deleted. [ 1652.881771] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5324b736-ef77-4a39-84e7-46739e2bcd2b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1653.163713] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1653.164161] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1653.164161] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1653.164348] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1653.164497] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1653.164649] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Segment Port d003817b-991f-475a-82b9-bb26d061ef69 not found, creating... [ 1653.164910] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1653.165080] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1653.165227] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1653.165455] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1653.165592] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1653.165873] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1653.166045] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1653.166161] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1653.166377] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1653.166532] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1653.166672] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Resource: SegmentPort with ID: d003817b-991f-475a-82b9-bb26d061ef69 is going to be created. [ 1653.186795] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1653.187014] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1653.187143] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1653.187483] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1653.187709] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1653.187927] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "port-d003817b-991f-475a-82b9-bb26d061ef69" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1653.866036] env[65065]: INFO networking_nsxv3.common.synchronization [req-d0bb5aea-8859-4797-8066-351798a85c2d req-ed36a0f9-8d2c-4652-a55b-70fbe6f42a42 service nova] Enqueued Resource ID: 5324b736-ef77-4a39-84e7-46739e2bcd2b with Priority: HIGHEST for action security_group_rules [ 1653.866689] env[65065]: INFO networking_nsxv3.common.synchronization [req-d0bb5aea-8859-4797-8066-351798a85c2d req-ed36a0f9-8d2c-4652-a55b-70fbe6f42a42 service nova] Enqueued Resource ID: 5324b736-ef77-4a39-84e7-46739e2bcd2b with Priority: HIGHEST for action security_group_members [ 1653.866854] env[65065]: INFO networking_nsxv3.common.synchronization [req-d0bb5aea-8859-4797-8066-351798a85c2d req-ed36a0f9-8d2c-4652-a55b-70fbe6f42a42 service nova] Enqueued Resource ID: d003817b-991f-475a-82b9-bb26d061ef69 with Priority: HIGHEST for action port [ 1653.867534] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5324b736-ef77-4a39-84e7-46739e2bcd2b with Priority: HIGHEST for action security_group_rules [ 1653.867623] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5324b736-ef77-4a39-84e7-46739e2bcd2b with Priority: HIGHEST for action security_group_members [ 1653.867728] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d003817b-991f-475a-82b9-bb26d061ef69 with Priority: HIGHEST for action port [ 1653.868015] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5324b736-ef77-4a39-84e7-46739e2bcd2b taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1653.868190] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5324b736-ef77-4a39-84e7-46739e2bcd2b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1653.868288] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5324b736-ef77-4a39-84e7-46739e2bcd2b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1653.868499] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5324b736-ef77-4a39-84e7-46739e2bcd2b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1653.868583] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5324b736-ef77-4a39-84e7-46739e2bcd2b',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1653.869476] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-5324b736-ef77-4a39-84e7-46739e2bcd2b taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1653.869592] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5324b736-ef77-4a39-84e7-46739e2bcd2b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1653.869661] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5324b736-ef77-4a39-84e7-46739e2bcd2b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1653.869833] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5324b736-ef77-4a39-84e7-46739e2bcd2b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1653.869992] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1653.870122] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1653.870212] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1653.870374] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1653.870463] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1653.870610] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5324b736-ef77-4a39-84e7-46739e2bcd2b',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1653.871345] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-d003817b-991f-475a-82b9-bb26d061ef69 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1653.871484] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d003817b-991f-475a-82b9-bb26d061ef69" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1653.871560] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d003817b-991f-475a-82b9-bb26d061ef69" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1653.871783] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d003817b-991f-475a-82b9-bb26d061ef69" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1653.871953] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d003817b-991f-475a-82b9-bb26d061ef69',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1654.374151] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5324b736-ef77-4a39-84e7-46739e2bcd2b',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1654.375294] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-5324b736-ef77-4a39-84e7-46739e2bcd2b taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1654.375459] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5324b736-ef77-4a39-84e7-46739e2bcd2b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1654.376931] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d003817b-991f-475a-82b9-bb26d061ef69 with status ACTIVE [ 1654.377058] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1654.377172] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1654.377279] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1654.377479] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1654.377593] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1654.377736] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1654.377830] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1654.377886] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1654.378046] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1654.378117] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1654.378337] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1654.378454] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1654.378509] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1654.378636] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1654.378702] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1654.378780] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d003817b-991f-475a-82b9-bb26d061ef69 is going to be updated. [ 1654.400995] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1654.401269] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1654.401269] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1654.401428] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1654.401558] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1654.401707] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d003817b-991f-475a-82b9-bb26d061ef69" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1654.876439] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5324b736-ef77-4a39-84e7-46739e2bcd2b',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1655.378874] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1655.379345] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1655.379345] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1655.379345] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1655.379504] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1655.379504] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5324b736-ef77-4a39-84e7-46739e2bcd2b is going to be created. [ 1655.403522] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1655.403777] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1655.403777] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1655.404027] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1655.404129] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1655.413959] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5324b736-ef77-4a39-84e7-46739e2bcd2b in Status: UNINITIALIZED for 2s [ 1657.424330] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5324b736-ef77-4a39-84e7-46739e2bcd2b in Status: SUCCESS [ 1657.424787] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5324b736-ef77-4a39-84e7-46739e2bcd2b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1657.424787] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5324b736-ef77-4a39-84e7-46739e2bcd2b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1657.424897] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5324b736-ef77-4a39-84e7-46739e2bcd2b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1657.425107] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1657.425232] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1657.425321] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1657.425451] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1657.425530] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1657.425615] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5324b736-ef77-4a39-84e7-46739e2bcd2b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1657.425704] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5324b736-ef77-4a39-84e7-46739e2bcd2b',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1657.927569] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5324b736-ef77-4a39-84e7-46739e2bcd2b',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1658.429548] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5324b736-ef77-4a39-84e7-46739e2bcd2b: rpc.has_security_group_logging(os_id): False [ 1658.588330] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1658.588602] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1658.588602] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1658.588783] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1658.588844] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1658.589080] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1658.589183] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1658.589254] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1658.589395] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1658.589468] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1658.589560] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5324b736-ef77-4a39-84e7-46739e2bcd2b is going to be created. [ 1658.655820] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1658.655996] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1658.656059] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1658.657376] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1658.657376] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1658.675201] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5324b736-ef77-4a39-84e7-46739e2bcd2b in Status: IN_PROGRESS for 2s [ 1658.868964] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1658.868964] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1660.690113] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5324b736-ef77-4a39-84e7-46739e2bcd2b in Status: SUCCESS [ 1660.690508] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5324b736-ef77-4a39-84e7-46739e2bcd2b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1663.870353] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1663.870712] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1668.871531] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1668.871903] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1673.873502] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1673.873971] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1678.874998] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1678.875383] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1683.876952] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1683.876952] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1688.879103] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1688.879459] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1693.880701] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1693.880701] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1698.881920] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1698.882330] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1699.962764] env[65065]: INFO networking_nsxv3.common.synchronization [req-738c4535-0907-4073-9ee7-766fc929117f req-fff0066e-6201-4cbb-bf7c-a28f7ac2a102 tempest-AttachVolumeNegativeTest-1821271617 tempest-AttachVolumeNegativeTest-1821271617-project-member] Enqueued Resource ID: 5324b736-ef77-4a39-84e7-46739e2bcd2b with Priority: HIGHEST for action security_group_members [ 1699.963667] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5324b736-ef77-4a39-84e7-46739e2bcd2b with Priority: HIGHEST for action security_group_members [ 1699.964152] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-5324b736-ef77-4a39-84e7-46739e2bcd2b taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1699.964293] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5324b736-ef77-4a39-84e7-46739e2bcd2b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1699.964378] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5324b736-ef77-4a39-84e7-46739e2bcd2b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1699.964583] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5324b736-ef77-4a39-84e7-46739e2bcd2b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1699.964742] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1699.964840] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1699.964903] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1699.965079] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1699.965162] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1699.965254] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5324b736-ef77-4a39-84e7-46739e2bcd2b',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1700.467483] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1700.467755] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1700.467755] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1700.467932] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1700.468034] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1700.468285] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1700.468393] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1700.468455] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1700.468608] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1700.468683] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1700.468767] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5324b736-ef77-4a39-84e7-46739e2bcd2b is going to be updated. [ 1700.498625] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1700.498878] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1700.498878] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1700.499039] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1700.499185] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1700.507883] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5324b736-ef77-4a39-84e7-46739e2bcd2b in Status: IN_PROGRESS for 2s [ 1702.520451] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5324b736-ef77-4a39-84e7-46739e2bcd2b in Status: SUCCESS [ 1702.520843] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5324b736-ef77-4a39-84e7-46739e2bcd2b deletion is rescheduled due to dependency. [ 1702.520843] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5324b736-ef77-4a39-84e7-46739e2bcd2b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1704.964831] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1704.965246] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1709.966878] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1709.966878] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1712.278384] env[65065]: INFO networking_nsxv3.common.synchronization [req-8cc7ea4e-74b6-4abc-804b-cd527f4b526a req-a6f3173f-f837-483b-97bf-a58c5f7c6b28 tempest-AttachVolumeNegativeTest-1821271617 tempest-AttachVolumeNegativeTest-1821271617-project-member] Enqueued Resource ID: bed648a2-307f-4d71-be6f-9c8512f84242 with Priority: HIGHEST for action security_group_members [ 1712.278570] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bed648a2-307f-4d71-be6f-9c8512f84242 with Priority: HIGHEST for action security_group_members [ 1712.278882] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-bed648a2-307f-4d71-be6f-9c8512f84242 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1712.278996] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bed648a2-307f-4d71-be6f-9c8512f84242" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1712.279224] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bed648a2-307f-4d71-be6f-9c8512f84242" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1712.279420] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bed648a2-307f-4d71-be6f-9c8512f84242" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1712.279664] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1712.279744] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1712.279744] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1712.279922] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1712.280036] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1712.280602] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bed648a2-307f-4d71-be6f-9c8512f84242',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1712.782148] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1712.782395] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1712.782395] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1712.782617] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1712.782711] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1712.782930] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1712.783050] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1712.783116] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1712.783288] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1712.783365] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1712.783461] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bed648a2-307f-4d71-be6f-9c8512f84242 is going to be updated. [ 1712.812151] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1712.812360] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1712.812360] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1712.812538] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1712.812676] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1712.821654] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bed648a2-307f-4d71-be6f-9c8512f84242 in Status: IN_PROGRESS for 2s [ 1714.832974] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bed648a2-307f-4d71-be6f-9c8512f84242 in Status: SUCCESS [ 1714.833379] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bed648a2-307f-4d71-be6f-9c8512f84242 deletion is rescheduled due to dependency. [ 1714.833379] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bed648a2-307f-4d71-be6f-9c8512f84242" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1716.925999] env[65065]: INFO networking_nsxv3.common.synchronization [None req-85fd891f-9025-48e0-b20d-a26e3129158a tempest-AttachVolumeNegativeTest-1821271617 tempest-AttachVolumeNegativeTest-1821271617-project-member] Enqueued Resource ID: 86ac1c9e-72a6-4d51-93ee-7d354547cad6 with Priority: HIGHEST for action security_group_rules [ 1716.926504] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86ac1c9e-72a6-4d51-93ee-7d354547cad6 with Priority: HIGHEST for action security_group_rules [ 1716.926810] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-86ac1c9e-72a6-4d51-93ee-7d354547cad6 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1716.926929] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-86ac1c9e-72a6-4d51-93ee-7d354547cad6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1716.926993] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-86ac1c9e-72a6-4d51-93ee-7d354547cad6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1716.927255] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-86ac1c9e-72a6-4d51-93ee-7d354547cad6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1716.927324] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('86ac1c9e-72a6-4d51-93ee-7d354547cad6',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1717.002268] env[65065]: INFO networking_nsxv3.common.synchronization [None req-6cfc8acf-a70c-4425-b200-3bb9370ef17e tempest-AttachVolumeNegativeTest-1821271617 tempest-AttachVolumeNegativeTest-1821271617-project-member] Enqueued Resource ID: 86ac1c9e-72a6-4d51-93ee-7d354547cad6 with Priority: HIGHEST for action security_group_rules [ 1717.002527] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86ac1c9e-72a6-4d51-93ee-7d354547cad6 with Priority: HIGHEST for action security_group_rules [ 1717.002901] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-86ac1c9e-72a6-4d51-93ee-7d354547cad6 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1717.002993] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-86ac1c9e-72a6-4d51-93ee-7d354547cad6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1717.448221] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1717.448408] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1717.448408] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1717.448598] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1717.448697] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1717.448816] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 86ac1c9e-72a6-4d51-93ee-7d354547cad6 already deleted. [ 1717.448916] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-86ac1c9e-72a6-4d51-93ee-7d354547cad6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1717.449112] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-86ac1c9e-72a6-4d51-93ee-7d354547cad6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1717.449300] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-86ac1c9e-72a6-4d51-93ee-7d354547cad6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1717.449361] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('86ac1c9e-72a6-4d51-93ee-7d354547cad6',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1718.042503] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1718.042945] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1718.042945] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1718.042945] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1718.043089] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1718.043089] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 86ac1c9e-72a6-4d51-93ee-7d354547cad6 already deleted. [ 1718.043164] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-86ac1c9e-72a6-4d51-93ee-7d354547cad6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1722.003610] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1722.003985] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1722.276951] env[65065]: INFO networking_nsxv3.common.synchronization [req-e2fa07e8-e3bd-4e1b-b07a-79edf2f3cf22 req-7cb99332-8c55-4667-8611-465822381093 tempest-AttachVolumeNegativeTest-1821271617 tempest-AttachVolumeNegativeTest-1821271617-project-member] Enqueued Resource ID: 86ac1c9e-72a6-4d51-93ee-7d354547cad6 with Priority: HIGHEST for action security_group_members [ 1722.277481] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86ac1c9e-72a6-4d51-93ee-7d354547cad6 with Priority: HIGHEST for action security_group_members [ 1722.277857] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-86ac1c9e-72a6-4d51-93ee-7d354547cad6 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1722.277988] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-86ac1c9e-72a6-4d51-93ee-7d354547cad6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1722.278066] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-86ac1c9e-72a6-4d51-93ee-7d354547cad6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1722.278316] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-86ac1c9e-72a6-4d51-93ee-7d354547cad6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1722.278472] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1722.278567] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1722.278629] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1722.278787] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1722.278885] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1722.278972] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('86ac1c9e-72a6-4d51-93ee-7d354547cad6',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1722.536307] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock network-657 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1722.536513] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "network-657" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1722.536636] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "network-657" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1722.536961] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "network-657" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1722.537170] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1722.537323] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1722.537437] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1722.537644] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1722.537835] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1722.538204] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1722.538355] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1722.538465] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1722.538577] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1722.538687] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1722.538791] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1722.538921] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1722.560115] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1722.560368] env[65065]: DEBUG dogpile.cache.region [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1722.560445] env[65065]: DEBUG dogpile.lock [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1722.560617] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "network-657" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1722.560931] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock port-e3cb2074-b14e-4d96-97a7-6c7a27a2640b taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1722.561126] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "port-e3cb2074-b14e-4d96-97a7-6c7a27a2640b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1722.561233] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "port-e3cb2074-b14e-4d96-97a7-6c7a27a2640b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1722.561562] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "port-e3cb2074-b14e-4d96-97a7-6c7a27a2640b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1722.561710] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e3cb2074-b14e-4d96-97a7-6c7a27a2640b',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1722.781464] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1722.781673] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1722.781673] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1722.781836] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1722.781917] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1722.782146] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1722.782289] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1722.782289] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1722.782434] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1722.782510] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1722.782591] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 86ac1c9e-72a6-4d51-93ee-7d354547cad6 already deleted. [ 1722.782667] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-86ac1c9e-72a6-4d51-93ee-7d354547cad6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1723.064426] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1723.064773] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1723.064773] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1723.065041] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1723.065197] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1723.065346] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Segment Port e3cb2074-b14e-4d96-97a7-6c7a27a2640b not found, creating... [ 1723.065592] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1723.065777] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1723.065900] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1723.066148] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1723.066284] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1723.066636] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1723.066802] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1723.066921] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1723.067152] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1723.067284] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1723.067420] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Resource: SegmentPort with ID: e3cb2074-b14e-4d96-97a7-6c7a27a2640b is going to be created. [ 1723.089047] env[65065]: DEBUG networking_nsxv3.common.locking [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1723.089260] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1723.089388] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1723.089670] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1723.089904] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1723.090172] env[65065]: DEBUG oslo_concurrency.lockutils [None req-f452e08b-707a-402f-9e4d-fcbfda8e6278 None None] Releasing lock "port-e3cb2074-b14e-4d96-97a7-6c7a27a2640b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1723.770698] env[65065]: INFO networking_nsxv3.common.synchronization [req-e2fa07e8-e3bd-4e1b-b07a-79edf2f3cf22 req-16dd04cf-259f-4a03-aaa9-1ba56941f265 service nova] Enqueued Resource ID: 86ac1c9e-72a6-4d51-93ee-7d354547cad6 with Priority: HIGHEST for action security_group_rules [ 1723.770888] env[65065]: INFO networking_nsxv3.common.synchronization [req-e2fa07e8-e3bd-4e1b-b07a-79edf2f3cf22 req-16dd04cf-259f-4a03-aaa9-1ba56941f265 service nova] Enqueued Resource ID: 86ac1c9e-72a6-4d51-93ee-7d354547cad6 with Priority: HIGHEST for action security_group_members [ 1723.771041] env[65065]: INFO networking_nsxv3.common.synchronization [req-e2fa07e8-e3bd-4e1b-b07a-79edf2f3cf22 req-16dd04cf-259f-4a03-aaa9-1ba56941f265 service nova] Enqueued Resource ID: e3cb2074-b14e-4d96-97a7-6c7a27a2640b with Priority: HIGHEST for action port [ 1723.771578] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86ac1c9e-72a6-4d51-93ee-7d354547cad6 with Priority: HIGHEST for action security_group_rules [ 1723.771773] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86ac1c9e-72a6-4d51-93ee-7d354547cad6 with Priority: HIGHEST for action security_group_members [ 1723.771805] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3cb2074-b14e-4d96-97a7-6c7a27a2640b with Priority: HIGHEST for action port [ 1723.772444] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-86ac1c9e-72a6-4d51-93ee-7d354547cad6 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1723.772590] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-86ac1c9e-72a6-4d51-93ee-7d354547cad6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1723.772654] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-86ac1c9e-72a6-4d51-93ee-7d354547cad6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1723.772861] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-86ac1c9e-72a6-4d51-93ee-7d354547cad6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1723.772949] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('86ac1c9e-72a6-4d51-93ee-7d354547cad6',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1723.773819] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-86ac1c9e-72a6-4d51-93ee-7d354547cad6 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1723.773931] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-86ac1c9e-72a6-4d51-93ee-7d354547cad6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1723.773996] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-86ac1c9e-72a6-4d51-93ee-7d354547cad6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1723.774174] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-86ac1c9e-72a6-4d51-93ee-7d354547cad6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1723.775026] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1723.775026] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1723.775026] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1723.775026] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1723.775026] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1723.775026] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('86ac1c9e-72a6-4d51-93ee-7d354547cad6',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1723.775766] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-e3cb2074-b14e-4d96-97a7-6c7a27a2640b taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1723.775766] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e3cb2074-b14e-4d96-97a7-6c7a27a2640b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1723.775766] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e3cb2074-b14e-4d96-97a7-6c7a27a2640b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1723.775898] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e3cb2074-b14e-4d96-97a7-6c7a27a2640b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1723.776000] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e3cb2074-b14e-4d96-97a7-6c7a27a2640b',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1724.277726] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-86ac1c9e-72a6-4d51-93ee-7d354547cad6 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1724.278192] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-86ac1c9e-72a6-4d51-93ee-7d354547cad6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1724.278192] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('86ac1c9e-72a6-4d51-93ee-7d354547cad6',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1724.278892] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e3cb2074-b14e-4d96-97a7-6c7a27a2640b with status ACTIVE [ 1724.279105] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1724.279221] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1724.279290] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1724.279486] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1724.279572] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1724.279737] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1724.279836] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1724.279925] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1724.280065] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1724.280163] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1724.280351] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1724.280483] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1724.280533] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1724.280636] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1724.280708] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1724.280791] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e3cb2074-b14e-4d96-97a7-6c7a27a2640b is going to be updated. [ 1724.301479] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1724.301722] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1724.301722] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1724.301882] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1724.301983] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1724.302145] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e3cb2074-b14e-4d96-97a7-6c7a27a2640b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1724.783200] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('86ac1c9e-72a6-4d51-93ee-7d354547cad6',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1725.093575] env[65065]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-5dc288ef-8933-4403-998f-272fe36b910d None None] NSXv3 Agent Agent loop - iteration:4 completed [ 1725.093746] env[65065]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-5dc288ef-8933-4403-998f-272fe36b910d None None] NSXv3 Agent Agent loop - iteration:5 started [ 1725.285682] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1725.286080] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1725.286080] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1725.286166] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1725.286245] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1725.286343] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 86ac1c9e-72a6-4d51-93ee-7d354547cad6 is going to be created. [ 1725.310630] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1725.310808] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1725.310858] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1725.311076] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1725.311249] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1725.320085] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 86ac1c9e-72a6-4d51-93ee-7d354547cad6 in Status: UNINITIALIZED for 2s [ 1727.330087] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 86ac1c9e-72a6-4d51-93ee-7d354547cad6 in Status: SUCCESS [ 1727.330540] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-86ac1c9e-72a6-4d51-93ee-7d354547cad6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1727.330540] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-86ac1c9e-72a6-4d51-93ee-7d354547cad6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1727.330639] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-86ac1c9e-72a6-4d51-93ee-7d354547cad6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1727.330834] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1727.330950] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1727.331020] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1727.331178] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1727.331255] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1727.331337] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-86ac1c9e-72a6-4d51-93ee-7d354547cad6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1727.331425] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('86ac1c9e-72a6-4d51-93ee-7d354547cad6',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1727.833404] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('86ac1c9e-72a6-4d51-93ee-7d354547cad6',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1728.336427] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 86ac1c9e-72a6-4d51-93ee-7d354547cad6: rpc.has_security_group_logging(os_id): False [ 1728.354114] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1728.354394] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1728.354394] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1728.354530] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1728.354617] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1728.354855] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1728.354952] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1728.355027] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1728.355180] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1728.355252] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1728.355335] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 86ac1c9e-72a6-4d51-93ee-7d354547cad6 is going to be created. [ 1728.412702] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1728.412933] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1728.412933] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1728.413110] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1728.413288] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1728.426923] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 86ac1c9e-72a6-4d51-93ee-7d354547cad6 in Status: IN_PROGRESS for 2s [ 1728.773035] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1728.773270] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1730.439842] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 86ac1c9e-72a6-4d51-93ee-7d354547cad6 in Status: SUCCESS [ 1730.440252] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-86ac1c9e-72a6-4d51-93ee-7d354547cad6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1733.775084] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1733.775084] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1738.776189] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1738.776577] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1743.777988] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1743.777988] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1748.779144] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1748.779522] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1753.780151] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1753.780594] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1757.002102] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1757.002102] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1757.002102] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1757.002615] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1757.002615] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1757.504875] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1758.009042] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1758.511028] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1758.511028] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1758.783746] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1758.783931] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1759.248656] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1759.249103] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1759.249103] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1759.249103] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1759.261656] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1759.262442] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1759.263219] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1759.297117] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1759.297317] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1759.297317] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1759.297513] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1759.310760] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1759.311491] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1759.311573] env[65065]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65065) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1759.311660] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1759.333774] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1759.333964] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1759.333964] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1759.334174] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1759.334507] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1759.334643] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1759.402541] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1759.402712] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1759.402771] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1759.402960] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1759.403308] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1759.403578] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1759.468535] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1759.468758] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1759.468758] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1759.468945] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1759.469300] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1759.469567] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:6. [ 1759.469649] env[65065]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'bed648a2-307f-4d71-be6f-9c8512f84242', 'e5af3025-e700-40cd-be52-f7ebbf00239f', '86ac1c9e-72a6-4d51-93ee-7d354547cad6', '5324b736-ef77-4a39-84e7-46739e2bcd2b', '4473193a-198b-4342-a9ef-a1966ddd9441', '1b329aa6-2b06-4112-ad10-7c2ede9e4774'} {{(pid=65065) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1759.469737] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1759.487243] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1759.487442] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1759.487442] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1759.487613] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1759.487696] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1759.487801] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1759.487871] env[65065]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65065) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1759.487942] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1759.559917] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1759.560160] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1759.560160] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1759.560347] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1759.561462] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1759.561709] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1759.561786] env[65065]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65065) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1759.561859] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1759.561926] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1759.562014] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 6/6 resources of Type:Security Group Rules [ 1759.562096] env[65065]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bed648a2-307f-4d71-be6f-9c8512f84242 with Priority: HIGH for action security_group_rules [ 1759.562176] env[65065]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e5af3025-e700-40cd-be52-f7ebbf00239f with Priority: HIGH for action security_group_rules [ 1759.562242] env[65065]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 86ac1c9e-72a6-4d51-93ee-7d354547cad6 with Priority: HIGH for action security_group_rules [ 1759.562304] env[65065]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5324b736-ef77-4a39-84e7-46739e2bcd2b with Priority: HIGH for action security_group_rules [ 1759.562365] env[65065]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4473193a-198b-4342-a9ef-a1966ddd9441 with Priority: HIGH for action security_group_rules [ 1759.562425] env[65065]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1b329aa6-2b06-4112-ad10-7c2ede9e4774 with Priority: HIGH for action security_group_rules [ 1759.562491] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 1759.562602] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 1759.562736] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , >, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1759.562829] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1759.562890] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1759.563061] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1759.563136] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1759.563314] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1759.563401] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1759.563457] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1759.563592] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1759.563662] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1759.563829] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1759.563918] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1759.563977] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1759.564123] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1759.564194] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1759.564361] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1759.564450] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1759.564504] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1759.564633] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1759.564702] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1759.564865] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1759.564951] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1759.565023] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1759.565161] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1759.565232] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1759.565397] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1759.565485] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1759.565542] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1759.565671] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1759.565744] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1759.565908] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1759.565990] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1759.566089] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1759.566235] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1759.566310] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1759.566479] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1759.566568] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1759.566625] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1759.566756] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1759.566826] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1759.566989] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1759.567091] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1759.567149] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1759.567281] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1759.567353] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1759.567514] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1759.567647] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1759.567647] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1759.567777] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1759.567844] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1759.568034] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1759.568144] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1759.568200] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1759.568337] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1759.568406] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1759.568582] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1759.568688] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1759.568748] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1759.568884] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1759.568954] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1759.569133] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1759.569221] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1759.569279] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1759.569409] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1759.569478] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1759.569641] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1759.569726] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1759.569783] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1759.569911] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1759.569981] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1759.570155] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1759.570244] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1759.570301] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1759.570459] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1759.570559] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1759.570734] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1759.570823] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1759.570880] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1759.571029] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1759.571101] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1759.571270] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1759.571359] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1759.571453] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1759.571545] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1759.571615] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1759.571776] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1759.571863] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1759.571922] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1759.572065] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1759.572136] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1759.572301] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1759.572388] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1759.572445] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1759.572574] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1759.572651] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1759.572807] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1759.572894] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1759.572951] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1759.573094] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1759.573165] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1759.573328] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1759.573415] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1759.573473] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1759.573601] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1759.573671] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1759.573833] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1759.573919] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1759.573977] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1759.574125] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1759.574196] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1759.574361] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1759.574445] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1759.574503] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1759.574634] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1759.574701] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1759.574875] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1759.574962] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1759.575031] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1759.575165] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1759.575236] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1759.575400] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1759.575487] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1759.575546] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1759.575675] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1759.575744] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1759.575905] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1759.575992] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1759.576066] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1759.576218] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1759.576289] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1759.576453] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1759.576541] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1759.576600] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1759.576728] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1759.576797] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1759.576957] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1759.577055] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1759.577114] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1759.577246] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1759.577314] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1759.577477] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1759.577562] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1759.577618] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1759.577747] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1759.577815] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1759.577975] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1759.578098] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1759.578156] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1759.578292] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1759.578362] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1759.578528] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1759.578616] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1759.578674] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1759.578801] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1759.578870] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1759.579049] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1759.579139] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1759.579199] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1759.579328] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1759.579397] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1759.579559] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1759.579647] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1759.579704] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1759.579832] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1759.579900] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1759.580075] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1759.580164] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1759.580223] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1759.580352] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1759.580437] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1759.580607] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1759.580698] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1759.580754] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1759.580884] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1759.580953] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1759.581129] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1759.581216] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1759.581272] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1759.581401] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1759.581470] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1759.581630] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1759.581714] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1759.581773] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1759.581901] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1759.581971] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1759.582147] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1759.582234] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1759.582290] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1759.582419] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1759.582488] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1759.582649] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1759.582735] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1759.582791] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1759.582919] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1759.582987] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1759.583161] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1759.583249] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1759.583306] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1759.583434] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1759.583502] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1759.583665] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1759.583749] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1759.583806] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1759.583930] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1759.584008] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1759.584171] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1759.584258] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1759.584314] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1759.584444] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1759.584512] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1759.584673] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1759.584758] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1759.584816] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1759.584943] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1759.585022] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1759.585188] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1759.585275] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1759.585334] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1759.585463] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1759.585532] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1759.585692] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1759.585778] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1759.585836] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1759.585966] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1759.586044] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1759.586234] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1759.586325] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1759.586383] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1759.586514] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1759.586585] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1759.586752] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1759.586833] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1759.586887] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1759.587027] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1759.587097] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1759.587262] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1759.587347] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1759.587404] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1759.587532] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1759.587601] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1759.587763] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1759.587848] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1759.587905] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1759.588045] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1759.588142] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1759.588315] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1759.588403] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1759.588459] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1759.588592] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1759.588662] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1759.588823] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1759.588910] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1759.588967] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1759.589128] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1759.589202] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1759.589368] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1759.589456] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1759.589513] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1759.589643] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1759.589712] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1759.589873] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1759.589959] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1759.590032] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1759.590164] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1759.590234] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1759.590431] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1759.590649] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1759.590727] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1759.590889] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1759.590969] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1759.591174] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1759.591271] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1759.591333] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1759.591471] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1759.591544] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1759.591714] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1759.591804] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1759.591863] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1759.591996] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1759.592083] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1759.592251] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1759.592340] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1759.592401] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1759.592532] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1759.592602] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1759.592766] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1759.592855] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1759.592913] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1759.593058] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1759.593129] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1759.593297] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1759.593396] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1759.593454] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1759.593588] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1759.593659] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1759.593823] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1759.593910] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1759.593967] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1759.594112] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1759.594182] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1759.594343] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1759.594430] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1759.594488] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1759.594615] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1759.594684] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1759.594846] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1759.594931] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1759.594987] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1759.595134] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1759.595207] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1759.595367] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1759.595452] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1759.595509] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1759.595661] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1759.595732] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1759.595896] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1759.595985] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1759.596097] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1759.596193] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1759.596264] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1759.596427] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1759.596512] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1759.596571] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1759.596700] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1759.596769] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1759.596931] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1759.597028] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1759.597089] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1759.597220] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1759.597290] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1759.597455] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1759.597545] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1759.597604] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1759.597735] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1759.597804] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1759.597966] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1759.598099] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1759.598155] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1759.598292] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1759.598362] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1759.598480] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 1759.598541] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 1759.598611] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1759.680881] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1759.681125] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1759.681178] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1759.681454] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1759.681917] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1759.682366] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1759.757098] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1759.757337] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1759.757337] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1759.757508] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1759.757804] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1759.770971] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1763.784798] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1763.785307] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=6], Jobs=0 [ 1763.785307] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bed648a2-307f-4d71-be6f-9c8512f84242 with Priority: HIGH for action security_group_rules [ 1763.785307] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86ac1c9e-72a6-4d51-93ee-7d354547cad6 with Priority: HIGH for action security_group_rules [ 1763.785307] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b329aa6-2b06-4112-ad10-7c2ede9e4774 with Priority: HIGH for action security_group_rules [ 1763.785461] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4473193a-198b-4342-a9ef-a1966ddd9441 with Priority: HIGH for action security_group_rules [ 1763.785461] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5af3025-e700-40cd-be52-f7ebbf00239f with Priority: HIGH for action security_group_rules [ 1763.785529] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5324b736-ef77-4a39-84e7-46739e2bcd2b with Priority: HIGH for action security_group_rules [ 1763.785871] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bed648a2-307f-4d71-be6f-9c8512f84242 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1763.786028] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bed648a2-307f-4d71-be6f-9c8512f84242" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1763.786073] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bed648a2-307f-4d71-be6f-9c8512f84242" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1763.786368] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bed648a2-307f-4d71-be6f-9c8512f84242" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1763.786467] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bed648a2-307f-4d71-be6f-9c8512f84242',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1763.787448] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-86ac1c9e-72a6-4d51-93ee-7d354547cad6 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1763.787565] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-86ac1c9e-72a6-4d51-93ee-7d354547cad6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1763.788174] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-86ac1c9e-72a6-4d51-93ee-7d354547cad6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1763.788174] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-86ac1c9e-72a6-4d51-93ee-7d354547cad6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1763.788174] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('86ac1c9e-72a6-4d51-93ee-7d354547cad6',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1763.788696] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1b329aa6-2b06-4112-ad10-7c2ede9e4774 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1763.788814] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1b329aa6-2b06-4112-ad10-7c2ede9e4774" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1763.788878] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1b329aa6-2b06-4112-ad10-7c2ede9e4774" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1763.789015] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1b329aa6-2b06-4112-ad10-7c2ede9e4774" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1763.789081] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1b329aa6-2b06-4112-ad10-7c2ede9e4774',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1763.790043] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4473193a-198b-4342-a9ef-a1966ddd9441 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1763.790149] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4473193a-198b-4342-a9ef-a1966ddd9441" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1763.790209] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4473193a-198b-4342-a9ef-a1966ddd9441" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1763.790354] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4473193a-198b-4342-a9ef-a1966ddd9441" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1763.790423] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4473193a-198b-4342-a9ef-a1966ddd9441',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1763.791440] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e5af3025-e700-40cd-be52-f7ebbf00239f taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1763.791440] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e5af3025-e700-40cd-be52-f7ebbf00239f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1763.791440] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e5af3025-e700-40cd-be52-f7ebbf00239f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1763.791440] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e5af3025-e700-40cd-be52-f7ebbf00239f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1763.791440] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e5af3025-e700-40cd-be52-f7ebbf00239f',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1763.792135] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5324b736-ef77-4a39-84e7-46739e2bcd2b taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1763.792257] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5324b736-ef77-4a39-84e7-46739e2bcd2b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1763.792327] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5324b736-ef77-4a39-84e7-46739e2bcd2b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1763.792713] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5324b736-ef77-4a39-84e7-46739e2bcd2b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1763.792713] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5324b736-ef77-4a39-84e7-46739e2bcd2b',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1764.297281] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-86ac1c9e-72a6-4d51-93ee-7d354547cad6 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1764.297497] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-86ac1c9e-72a6-4d51-93ee-7d354547cad6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1764.297497] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-86ac1c9e-72a6-4d51-93ee-7d354547cad6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1764.297668] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-86ac1c9e-72a6-4d51-93ee-7d354547cad6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1764.297827] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1764.297924] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1764.297988] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1764.298194] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1764.298275] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1764.298358] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-86ac1c9e-72a6-4d51-93ee-7d354547cad6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1764.298441] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('86ac1c9e-72a6-4d51-93ee-7d354547cad6',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1764.328842] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1764.329097] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1764.329097] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1764.329257] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1764.330852] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1764.330936] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1764.331629] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1764.331717] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1764.332347] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1764.332440] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1764.333117] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1764.333209] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1764.350725] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1764.350872] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bed648a2-307f-4d71-be6f-9c8512f84242 is going to be deleted. [ 1764.351684] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1764.351885] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1764.368794] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1764.368964] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4473193a-198b-4342-a9ef-a1966ddd9441 is going to be deleted. [ 1764.369785] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1764.369997] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1764.406315] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1764.406490] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e5af3025-e700-40cd-be52-f7ebbf00239f is going to be deleted. [ 1764.407370] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1764.407581] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1764.408976] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1764.409114] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1764.426421] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1764.426581] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1b329aa6-2b06-4112-ad10-7c2ede9e4774 is going to be deleted. [ 1764.427400] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1764.427610] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1764.440970] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1764.441178] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1764.446465] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1764.446606] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5324b736-ef77-4a39-84e7-46739e2bcd2b is going to be deleted. [ 1764.447444] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1764.447658] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1764.447744] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1764.447862] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bed648a2-307f-4d71-be6f-9c8512f84242" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1764.448022] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1764.448237] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1764.448314] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1764.448422] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4473193a-198b-4342-a9ef-a1966ddd9441" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1764.491945] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1764.492166] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1764.492166] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1764.492369] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1764.492459] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1764.492575] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1b329aa6-2b06-4112-ad10-7c2ede9e4774" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1764.496596] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1764.496790] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1764.496790] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1764.496967] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1764.497063] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1764.497180] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e5af3025-e700-40cd-be52-f7ebbf00239f" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1764.527161] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1764.527369] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1764.527369] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1764.527574] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1764.527662] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1764.527780] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5324b736-ef77-4a39-84e7-46739e2bcd2b" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1764.801367] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('86ac1c9e-72a6-4d51-93ee-7d354547cad6',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1765.303863] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 86ac1c9e-72a6-4d51-93ee-7d354547cad6: rpc.has_security_group_logging(os_id): False [ 1765.322023] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1765.322243] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1765.322243] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1765.322441] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1765.354639] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1765.354941] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1765.355078] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1765.355145] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1765.355346] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1765.355429] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1765.355516] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 86ac1c9e-72a6-4d51-93ee-7d354547cad6 is going to be updated. [ 1765.414458] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1765.414685] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1765.414685] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1765.414889] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1765.415046] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1765.426228] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 86ac1c9e-72a6-4d51-93ee-7d354547cad6 in Status: IN_PROGRESS for 2s [ 1767.440739] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 86ac1c9e-72a6-4d51-93ee-7d354547cad6 in Status: SUCCESS [ 1767.440739] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-86ac1c9e-72a6-4d51-93ee-7d354547cad6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1768.786925] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1768.786925] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1773.788528] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1773.789039] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1778.789807] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1778.790180] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1783.791374] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1783.791650] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1784.094359] env[65065]: INFO networking_nsxv3.common.synchronization [req-5c7e68e9-8487-4bf6-8d96-c4e389886e1a req-28cad34d-d573-4203-ad19-8ea5a0099bad tempest-AttachVolumeNegativeTest-1821271617 tempest-AttachVolumeNegativeTest-1821271617-project-member] Enqueued Resource ID: 86ac1c9e-72a6-4d51-93ee-7d354547cad6 with Priority: HIGHEST for action security_group_members [ 1784.095293] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86ac1c9e-72a6-4d51-93ee-7d354547cad6 with Priority: HIGHEST for action security_group_members [ 1784.096878] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-86ac1c9e-72a6-4d51-93ee-7d354547cad6 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1784.096878] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-86ac1c9e-72a6-4d51-93ee-7d354547cad6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1784.096878] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-86ac1c9e-72a6-4d51-93ee-7d354547cad6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1784.096878] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-86ac1c9e-72a6-4d51-93ee-7d354547cad6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1784.097150] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1784.097150] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1784.097150] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1784.097277] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1784.097311] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1784.097468] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('86ac1c9e-72a6-4d51-93ee-7d354547cad6',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1784.599785] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1784.600088] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1784.600088] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1784.600299] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1784.600391] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1784.600588] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1784.600685] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1784.600738] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1784.600883] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1784.600956] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1784.601053] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 86ac1c9e-72a6-4d51-93ee-7d354547cad6 is going to be updated. [ 1784.635809] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1784.636084] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1784.636084] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1784.636221] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1784.636362] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1784.644387] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 86ac1c9e-72a6-4d51-93ee-7d354547cad6 in Status: IN_PROGRESS for 2s [ 1786.654510] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 86ac1c9e-72a6-4d51-93ee-7d354547cad6 in Status: SUCCESS [ 1786.654879] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 86ac1c9e-72a6-4d51-93ee-7d354547cad6 deletion is rescheduled due to dependency. [ 1786.654879] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-86ac1c9e-72a6-4d51-93ee-7d354547cad6" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1788.773738] env[65065]: INFO networking_nsxv3.common.synchronization [None req-4ff755da-a0a7-41eb-bd67-82d44d23d65a tempest-AttachVolumeNegativeTest-1821271617 tempest-AttachVolumeNegativeTest-1821271617-project-member] Enqueued Resource ID: 08c1a2b6-233e-4e78-bd6b-07267c9f00b2 with Priority: HIGHEST for action security_group_rules [ 1788.774330] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08c1a2b6-233e-4e78-bd6b-07267c9f00b2 with Priority: HIGHEST for action security_group_rules [ 1788.774657] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-08c1a2b6-233e-4e78-bd6b-07267c9f00b2 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1788.774778] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-08c1a2b6-233e-4e78-bd6b-07267c9f00b2" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1788.774864] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-08c1a2b6-233e-4e78-bd6b-07267c9f00b2" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1788.775175] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-08c1a2b6-233e-4e78-bd6b-07267c9f00b2" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1788.775258] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('08c1a2b6-233e-4e78-bd6b-07267c9f00b2',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1788.853374] env[65065]: INFO networking_nsxv3.common.synchronization [None req-95f338c3-8df9-4b15-a80f-0ef3b2281d1f tempest-AttachVolumeNegativeTest-1821271617 tempest-AttachVolumeNegativeTest-1821271617-project-member] Enqueued Resource ID: 08c1a2b6-233e-4e78-bd6b-07267c9f00b2 with Priority: HIGHEST for action security_group_rules [ 1788.854114] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08c1a2b6-233e-4e78-bd6b-07267c9f00b2 with Priority: HIGHEST for action security_group_rules [ 1788.854454] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-08c1a2b6-233e-4e78-bd6b-07267c9f00b2 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1788.854545] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-08c1a2b6-233e-4e78-bd6b-07267c9f00b2" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1789.295616] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1789.295777] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1789.295824] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1789.296042] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1789.296133] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1789.296260] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 08c1a2b6-233e-4e78-bd6b-07267c9f00b2 already deleted. [ 1789.296343] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-08c1a2b6-233e-4e78-bd6b-07267c9f00b2" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1789.296492] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-08c1a2b6-233e-4e78-bd6b-07267c9f00b2" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1789.296645] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-08c1a2b6-233e-4e78-bd6b-07267c9f00b2" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1789.296728] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('08c1a2b6-233e-4e78-bd6b-07267c9f00b2',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1789.816490] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1789.816893] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1789.816893] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1789.816893] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1789.817040] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1789.817081] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 08c1a2b6-233e-4e78-bd6b-07267c9f00b2 already deleted. [ 1789.817138] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-08c1a2b6-233e-4e78-bd6b-07267c9f00b2" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1793.855626] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1793.855955] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1794.189574] env[65065]: INFO networking_nsxv3.common.synchronization [req-89db0692-3987-4012-bbf9-3112eb7935fc req-3ff17e6c-35dd-4a8c-a07f-dac15af48dfa tempest-AttachVolumeNegativeTest-1821271617 tempest-AttachVolumeNegativeTest-1821271617-project-member] Enqueued Resource ID: 08c1a2b6-233e-4e78-bd6b-07267c9f00b2 with Priority: HIGHEST for action security_group_members [ 1794.190329] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08c1a2b6-233e-4e78-bd6b-07267c9f00b2 with Priority: HIGHEST for action security_group_members [ 1794.190446] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-08c1a2b6-233e-4e78-bd6b-07267c9f00b2 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1794.190529] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08c1a2b6-233e-4e78-bd6b-07267c9f00b2" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1794.190582] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08c1a2b6-233e-4e78-bd6b-07267c9f00b2" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1794.190834] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08c1a2b6-233e-4e78-bd6b-07267c9f00b2" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1794.190983] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1794.191087] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1794.191149] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1794.191298] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1794.191381] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1794.191470] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('08c1a2b6-233e-4e78-bd6b-07267c9f00b2',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1794.483107] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock network-657 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1794.483337] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "network-657" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1794.483463] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "network-657" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1794.483760] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "network-657" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1794.484023] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1794.484183] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1794.484298] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1794.484539] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1794.484686] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1794.484927] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1794.485048] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] NeedRegenerationException {{(pid=65065) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1794.485155] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] no value, waiting for create lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1794.485260] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] value creation lock acquired {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1794.485366] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] No value present for key: 'zone-id' {{(pid=65065) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1794.485469] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Calling creation function for not-yet-present value {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1794.485598] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1794.504822] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1794.504977] env[65065]: DEBUG dogpile.cache.region [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65065) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1794.505116] env[65065]: DEBUG dogpile.lock [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Released creation lock {{(pid=65065) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1794.505278] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "network-657" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1794.505561] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock port-286517de-d28c-4551-b8a9-b35539bd09c7 taken with stack trace [, , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1794.505721] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "port-286517de-d28c-4551-b8a9-b35539bd09c7" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1794.505837] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "port-286517de-d28c-4551-b8a9-b35539bd09c7" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1794.506155] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "port-286517de-d28c-4551-b8a9-b35539bd09c7" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1794.506315] env[65065]: DEBUG networking_nsxv3.api.rpc [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('286517de-d28c-4551-b8a9-b35539bd09c7',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1794.694467] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1794.694679] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1794.694776] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1794.695126] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1794.695287] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1794.695602] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1794.695768] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1794.695884] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1794.696153] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1794.696290] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1794.696432] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 08c1a2b6-233e-4e78-bd6b-07267c9f00b2 already deleted. [ 1794.696576] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08c1a2b6-233e-4e78-bd6b-07267c9f00b2" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1795.009130] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1795.009547] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1795.009547] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1795.009744] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1795.009895] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1795.010057] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Segment Port 286517de-d28c-4551-b8a9-b35539bd09c7 not found, creating... [ 1795.010329] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1795.010507] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1795.010621] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1795.010836] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1795.010970] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1795.011269] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1795.011423] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1795.011539] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1795.011739] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1795.011871] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1795.012014] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Resource: SegmentPort with ID: 286517de-d28c-4551-b8a9-b35539bd09c7 is going to be created. [ 1795.033776] env[65065]: DEBUG networking_nsxv3.common.locking [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1795.034018] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1795.034102] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1795.034356] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1795.034589] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1795.034798] env[65065]: DEBUG oslo_concurrency.lockutils [None req-b4f44d2b-5f63-4c04-a512-4d9ce6c4bdd3 None None] Releasing lock "port-286517de-d28c-4551-b8a9-b35539bd09c7" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1795.719737] env[65065]: INFO networking_nsxv3.common.synchronization [req-89db0692-3987-4012-bbf9-3112eb7935fc req-e4154dfc-2727-4f03-a2c5-0542e547f8c4 service nova] Enqueued Resource ID: 08c1a2b6-233e-4e78-bd6b-07267c9f00b2 with Priority: HIGHEST for action security_group_rules [ 1795.719914] env[65065]: INFO networking_nsxv3.common.synchronization [req-89db0692-3987-4012-bbf9-3112eb7935fc req-e4154dfc-2727-4f03-a2c5-0542e547f8c4 service nova] Enqueued Resource ID: 08c1a2b6-233e-4e78-bd6b-07267c9f00b2 with Priority: HIGHEST for action security_group_members [ 1795.720066] env[65065]: INFO networking_nsxv3.common.synchronization [req-89db0692-3987-4012-bbf9-3112eb7935fc req-e4154dfc-2727-4f03-a2c5-0542e547f8c4 service nova] Enqueued Resource ID: 286517de-d28c-4551-b8a9-b35539bd09c7 with Priority: HIGHEST for action port [ 1795.720589] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08c1a2b6-233e-4e78-bd6b-07267c9f00b2 with Priority: HIGHEST for action security_group_rules [ 1795.720729] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08c1a2b6-233e-4e78-bd6b-07267c9f00b2 with Priority: HIGHEST for action security_group_members [ 1795.720823] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 286517de-d28c-4551-b8a9-b35539bd09c7 with Priority: HIGHEST for action port [ 1795.721237] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock rules-08c1a2b6-233e-4e78-bd6b-07267c9f00b2 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1795.721370] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-08c1a2b6-233e-4e78-bd6b-07267c9f00b2" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1795.721454] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-08c1a2b6-233e-4e78-bd6b-07267c9f00b2" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1795.721627] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-08c1a2b6-233e-4e78-bd6b-07267c9f00b2" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1795.721710] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('08c1a2b6-233e-4e78-bd6b-07267c9f00b2',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1795.723737] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-08c1a2b6-233e-4e78-bd6b-07267c9f00b2 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1795.723846] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08c1a2b6-233e-4e78-bd6b-07267c9f00b2" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1795.723993] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08c1a2b6-233e-4e78-bd6b-07267c9f00b2" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1795.724118] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08c1a2b6-233e-4e78-bd6b-07267c9f00b2" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1795.724271] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1795.724381] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1795.724477] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1795.724591] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1795.724686] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1795.724811] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('08c1a2b6-233e-4e78-bd6b-07267c9f00b2',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1795.726489] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock port-286517de-d28c-4551-b8a9-b35539bd09c7 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1795.726489] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-286517de-d28c-4551-b8a9-b35539bd09c7" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1795.726489] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-286517de-d28c-4551-b8a9-b35539bd09c7" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1795.726489] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-286517de-d28c-4551-b8a9-b35539bd09c7" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1795.726489] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('286517de-d28c-4551-b8a9-b35539bd09c7',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1796.224109] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-08c1a2b6-233e-4e78-bd6b-07267c9f00b2 taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1796.224431] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08c1a2b6-233e-4e78-bd6b-07267c9f00b2" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1796.227727] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('08c1a2b6-233e-4e78-bd6b-07267c9f00b2',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1796.229080] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 286517de-d28c-4551-b8a9-b35539bd09c7 with status ACTIVE [ 1796.229080] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1796.229278] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1796.229387] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1796.229835] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1796.229835] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1796.229979] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1796.230106] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1796.230188] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1796.230404] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1796.230524] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1796.230798] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1796.230948] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1796.231072] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1796.231289] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1796.231415] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1796.231600] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 286517de-d28c-4551-b8a9-b35539bd09c7 is going to be updated. [ 1796.253840] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1796.254057] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1796.254057] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1796.254232] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1796.254360] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1796.254530] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-286517de-d28c-4551-b8a9-b35539bd09c7" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1796.735204] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('08c1a2b6-233e-4e78-bd6b-07267c9f00b2',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1797.237576] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1797.237990] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1797.237990] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1797.237990] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1797.238125] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1797.238201] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 08c1a2b6-233e-4e78-bd6b-07267c9f00b2 is going to be created. [ 1797.259881] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1797.260139] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1797.260139] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1797.260286] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1797.260441] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1797.269613] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08c1a2b6-233e-4e78-bd6b-07267c9f00b2 in Status: UNINITIALIZED for 2s [ 1799.280865] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08c1a2b6-233e-4e78-bd6b-07267c9f00b2 in Status: SUCCESS [ 1799.280865] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08c1a2b6-233e-4e78-bd6b-07267c9f00b2" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1799.280865] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08c1a2b6-233e-4e78-bd6b-07267c9f00b2" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1799.281409] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08c1a2b6-233e-4e78-bd6b-07267c9f00b2" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1799.281409] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1799.281409] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1799.281409] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1799.281409] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1799.281672] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1799.281672] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08c1a2b6-233e-4e78-bd6b-07267c9f00b2" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1799.281672] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('08c1a2b6-233e-4e78-bd6b-07267c9f00b2',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1799.784227] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('08c1a2b6-233e-4e78-bd6b-07267c9f00b2',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1800.288552] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 08c1a2b6-233e-4e78-bd6b-07267c9f00b2: rpc.has_security_group_logging(os_id): False [ 1800.306390] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1800.306594] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1800.306594] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1800.306721] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1800.306806] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1800.307046] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1800.307147] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1800.307211] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1800.307359] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1800.307434] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1800.307520] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 08c1a2b6-233e-4e78-bd6b-07267c9f00b2 is going to be created. [ 1800.364399] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1800.364626] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1800.364626] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1800.364816] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1800.364992] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1800.375529] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 08c1a2b6-233e-4e78-bd6b-07267c9f00b2 in Status: IN_PROGRESS for 2s [ 1800.721590] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1800.721767] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1802.388236] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 08c1a2b6-233e-4e78-bd6b-07267c9f00b2 in Status: SUCCESS [ 1802.388686] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-08c1a2b6-233e-4e78-bd6b-07267c9f00b2" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1805.722636] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1805.723114] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1810.724424] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1810.724424] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1815.725153] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1815.725525] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1820.726674] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1820.727239] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1825.727711] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1825.727711] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1830.728923] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1830.729351] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1835.730811] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1835.731216] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1840.732413] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1840.732892] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1845.733687] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1845.734126] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1850.735272] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1850.735652] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1855.736414] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1855.736919] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1856.628454] env[65065]: INFO networking_nsxv3.common.synchronization [req-72604571-de1e-4bd8-9869-d621261a2815 req-14f14aa9-0af6-418b-b86d-2eb804f8a8e0 tempest-AttachVolumeNegativeTest-1821271617 tempest-AttachVolumeNegativeTest-1821271617-project-member] Enqueued Resource ID: 08c1a2b6-233e-4e78-bd6b-07267c9f00b2 with Priority: HIGHEST for action security_group_members [ 1856.628645] env[65065]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08c1a2b6-233e-4e78-bd6b-07267c9f00b2 with Priority: HIGHEST for action security_group_members [ 1856.629000] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock member-08c1a2b6-233e-4e78-bd6b-07267c9f00b2 taken with stack trace [, , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1856.629133] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08c1a2b6-233e-4e78-bd6b-07267c9f00b2" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1856.629203] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08c1a2b6-233e-4e78-bd6b-07267c9f00b2" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1856.629393] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08c1a2b6-233e-4e78-bd6b-07267c9f00b2" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1856.629557] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1856.629651] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1856.629711] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1856.629858] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1856.629940] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1856.630601] env[65065]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('08c1a2b6-233e-4e78-bd6b-07267c9f00b2',) {} {{(pid=65065) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1857.132831] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1857.133263] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1857.133263] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1857.133356] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1857.133427] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1857.133628] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1857.133742] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1857.133784] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1857.133929] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1857.134036] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1857.134137] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 08c1a2b6-233e-4e78-bd6b-07267c9f00b2 is going to be updated. [ 1857.167323] env[65065]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65065) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1857.167533] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1857.167533] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1857.167722] env[65065]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1857.167861] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1857.175986] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08c1a2b6-233e-4e78-bd6b-07267c9f00b2 in Status: IN_PROGRESS for 2s [ 1859.188521] env[65065]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08c1a2b6-233e-4e78-bd6b-07267c9f00b2 in Status: SUCCESS [ 1859.188950] env[65065]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 08c1a2b6-233e-4e78-bd6b-07267c9f00b2 deletion is rescheduled due to dependency. [ 1859.188950] env[65065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08c1a2b6-233e-4e78-bd6b-07267c9f00b2" {{(pid=65065) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1861.629459] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1861.629867] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1866.631256] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1866.631687] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1871.633224] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1871.633615] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1876.634791] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1876.635215] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1881.636300] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1881.636748] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1886.638226] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1886.638226] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1891.639150] env[65065]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1891.639507] env[65065]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0